Yes. Once The pokemon holding the balloon is attacked by a non ground move, the balloon will be gone just like a gem disappears after a move of the gems type is used.
-ex- Groudon holds a balloon. If kyoger uses ice beam on Groudon, Groudon will loose his balloon (& probably faint).
Hope this helps:)