James is talented enough to play safety in college and play it well. If the choices are stay in the secondary or transfer to somewhere that will let him do that then you keep him at safety.
That said, its pretty easy to see he is not maximizing his gifts. You always want to be the biggest...