The most common "argument" is that it weakens the regular season (it won't) and that 8 teams are too many and will dilute the quality of the Playoff (it's the perfect number and will add to the quality of the Playoff).
The most common person making this argument? TV talking heads and radio...