I think that the key was that he couldn't do AS MANY "high degree of difficulty" bits in character.
For instance, when he was trying to do the song at the redneck rally, he was recognized. Apparently, there were some non-MAGA types there to observe the event, and they recognized him (and...