I think 6 teams is probably right.
Every Power 5 Conference winner + the best of the rest. Gives the SEC a chance to get a second team in and / or opens the door for a Cinci / UCF.
Top 4 get a bye, worst Power 5 Conference winner plays the second ACC / SEC etc team.