I don't believe it's "Baker's defense." Though maybe it was for a couple of games...
For better or worse, I think this is Manny's defense. And when your HC comes out and cuts your DC at the knees, it probably has an adverse impact on how that DC is perceived by the locker room.