The Football Association (FA) in England has charged West Bromwich Manager, Slaven Bilic, over 'improper conduct' during Saturday's defeat against Everton at the Goodison Park.
West Browmich defender Kieran Gibbs was sent off after a retaliatory push of James due to an initial challenge by the Colombian.
The Manager showed disapproval of the red card which also earned him a marching order by the referee too.
An FA statement said, "It is alleged that the West Bromwich Albion FC manager's language and/or behaviour on the field of play at half-time of the Premier League fixture against Everton FC on 19 September amounts to improper conduct."
Bilic has until Thursday to respond.
The charge could result in a two-match touchline ban if evidence of abusive or insulting language is found.
The 52-year-old Croatian added, "As a manager I should be in a situation to ask the referee what's going on.
"It's not like the game was going on, it was half-time - nobody was around. I didn't swear. I asked him in a frustrated way but I didn't go over the line. But he just ignored me and gave me red.
"As a manager you have that right if you are not crossing the line. I told him if you want to kill us, kill us. That's all."
West Brom lost all 6 points of their first two games of the Premier League season, conceding eight goals in the process.