Well, if you're confident that it won't matter to much, then it's fine.
People usually want to take the least amount of damage from Foul Play and confusion on Special Attackers, but it seems you already figured that out lol.
It seems like your Venusaur can tank Foul Play, so that doesn't seem to be a problem. I assume Confusion won't do that much either.
While it is usually important in competitive play to have 0 IVs on a Special Attacker/walls without a physical move, it's really your decision. Like I said, Foul Play and Confusion don't seem to be that dangerous for your Venusaur, so I wouldn't stress it.
Hope this helps! :)
Btw, congrats on the shiny! :)))