Make a copy of the func_brush in almost the same position and set it to never solid. Then, change your old func_brush is texture to the "clip texture" and enable/disable it for turning the collision on and off.
So, you will always have a visible, uncollidable brush and a invisible brush, capable of changing it's solidity