In a regular season, yes. This season is all about intraconference play. We'd be giving them a shot at looking more credible and it does nothing for us to beat them.
Personally, I'm firmly in the anyone, anytime, anywhere camp, but I doubt the administration is.