Not a joke, go look it up. He didn't call plays last season, and wasn't very involved until he was forced to be when Baker appeared to be in over his head.
You are correct, Manny's defenses do have a high floor. The problem is, Manny isn't calling the plays, Baker is. That's why you get 4th and 17 safety blitzes from 20 yards away.