There will always be an issue with either way of scheduling, just as simple as that. I mean it is no different than there always being an issue with how the final 4 are selected for the CFP.
It's college sports, and the absolute hardest part about it is making everyone happy