When you obtain all the gym leaders numbers, you're only allowed to fight them unlimited times during certain times of days.
For example: For Blaine, you can only fight him Tuesday Noons, so depending on your Pokegear/Nintendo DS clock, you can only fight Blaine on Tuesday, at noon.