At this point, it's all speculation. What we know from the press conference is that James said there was no push towards removing Richt. Richt agreed that "changes" needed to be made. You can't get more vague than that.
He was forced to fire Golden and didn't put any real pressure on Richt after this atrocious season. As happy as I am about Richt retiring, I wish that announcement would have been made due to James being fired.