I think he's saying that if most people agree on something, it's obviously stupid but he's the only one smart enough to see it.
Just go back to following the herd like the rest of us, and don't feel bad. It's not our fault, we just aren't as smart as him.