If you are talking about a Saturday, I would give yourself about 30 minutes, though there are a couple of variables.
If by "Disney area" you mean Disney property or US 192, it would probably take a bit more time. If you are talking about hotel row (Lake Buena Vista) or closer to Sea World, it will take less time.
Check Google Maps that morning, see if there are any accidents or weekend I-4 lane/exit closures, as they are doing a ton of construction on I-4.
11 am Saturday traffic is usually worse going TO Disney than AWAY FROM Disney, but sometimes there are bottlenecks around the Sea World exit or the Universal/International Drive exits.
By the time you hit the disastrous East-West Expressway exit, you're almost to the stadium anyhow.