No it isn't possible, there will be someone blocking the east exit leading to Route 4, who will not leave until you defeat Brock.
