So after spending awhile deleting brushes and testing the map with each particular brush removed I narrowed it down to one brush. If the brush existed, it glitched, if it wasn't there the area was fine. I turned the brush into a func_detail and no I'm no longer having the problem. If anyone has insight into why this worked I would be interested but thanks for the help.