I think there are a couple of reasons for the drop off behind teams like Vandy, etc.
First of all, a lot of top draft pics out of HS are from Florida. Morris would have had top 5 recruiting classes his last 2-3 years if his recruits weren't drafted so high and signed pro contracts.
Secondly...