Some observations overall from the thread:
In early versions of your map, when glaring flaws present themselves, typically you don't want to test your map versions repeatedly; you'd prefer to create new versions relatively fast until your map becomes stable. Early map tests typically span around 30 minutes, and during this time you want the most accurate data, and to get the most accurate data you want the lowest amount of randomness available - no random crits.
When your map becomes stable enough to handle multiple map tests (alpha 5 ish), the choice between having crits on or off comes down to the author's preference. If you're making a map for an environment where crits will be off (competitive maps) then you should have crits off for these stable-map map tests. If you don't care where it ends up, it's just your user preference - do you like crits or not.
When your map becomes even more stable, enough to be moved around to other server environments (beta usually), then testing with crits on and off is equally as important, because you want the most amount of environment variables tested (crits on or off, player skill, etc).
Early map tests: Crits off.
Stable map tests: Preference.
Stable enough to move to other servers: Both.
Having a vote may be useful for introducing the high-level opinions from people who don't want to read through the posts.