Why would anyone bring a kid under 2 to a game?
They have no idea what's going on, they'll be miserable, and likely ruin the experience for anyone sitting near them.
The few things that stimulate infants are color, sound and movement - so your assessment is way off.
My kid is 8 months old, as soon as it was safe to take him in public we starting taking him to museums, movies, basketball games, concerts, etc.. If he fuses, we remove him from other people, but he rarely does. All great stimulation for what has now become a ridiculously happy and well tempered baby. He just made a roundtrip flight to Hawaii at 6 months (9 hours each way) with barely a peep except when he was hungry. At basketball games when the crowd cheers, he gets really excited - only a problem when we take him to away games and he cheers when the home/opposing crowd cheers.
The babies you are thinking of are the ones that never get taken out in public, like our friends babies who can't leave the house after 7pm because that's bedtime.
If you hate babies crying in public, you should encourage people to take their babies out and acclimate them properly. With the obvious exceptions for places that are TOO loud, crowded, hot, etc.. The parents can always leave.
All that being said, some football games (sold out Miami games included) are environments that would give me pause to take him. He'll probably go to his first Miami game at UNC or Duke this year (tame environments), but I'm not taking him to Blacksburg, a game against FSU, etc. because of the amount of drunk idiots running around.