Brickell is way better than downtown but I would only go if you are planning on renting a car and exploring. It's not a standalone place like the Beach.
For my money, the Grove is the best central location because the traffic is better (Brickell can get real backed up with the drawbridge)...