Stop and re-read what I was saying. I'm dismissing your argument not because it's something I don't want to do, but because implying that 70 maps tested at 10 per day at 20+ people each day for 2 weeks solid is an absolutely ridiculous idea. 10 a day for 2 weeks, thats each map, played twice. In essence, 140 maps played in 2 weeks. I don't think I'm the only person who thinks that is impossibly ridiculous. There are some days when we can barely manage to get 15 people for 2 tests, and most of the time, the tests die off after 3 maps. If you push that kind of testing, you're going to get author/player burn out before development even begins at the end of 2 weeks.
In the last few weeks I've seen two imps a day last for 6+ maps each being full until the end. I don't believe that 10 per day, 5EU/5US is in any way overkill. No one has to play _all_ of them (except if you
desperately need prizes to justify this contest). There are enough members here (and heck, we could call in troops from elsewhere if needs be) to keep things going.
Many people here could probably attest to burnout and how it sucks. At the end of a 72hr weekend, most people don't want to touch TF2 for a few days, just to recoup.
Few days of burnout vs being prevented from updating for two months. Yeah people want a few days off, but no one wants two months off.
Additionally: Who would host all the tests? Who's going to decide what goes where
Ido has already made a test schedule for this contest, so this isn't exactly an issue in any way. If we have judges, they're running tests, if not, staff/vips are recruited to run the tests, just like normal imps and gamedays. No big deal.
In addition, expecting a 'small pool of judges' to go through 70 maps and write up decent feedback for each and everyone one... in two weeks, is equally as ridiculous. I can barely get judges to cover the major contests which have 10 maps, in addition to getting them to do it within a reasonable timeframe. This solution expects too much of participants and judges.
Judges aren't there to provide detailed feedback. They can if they want to but, as you say, expecting
anyone to write up detailed feedback for 70 maps over
any period of time is ridiculous. It's probably why no one wants to judge. It's a more mammoth task than playing 70 the maps, and they have to do both!
No. Instead I suggested that the judges are just picking out notable entries to award prizes to. Like:
Judges favourite
Best gimmick
Most creative
Most mindbendlingly accomplished
Best use of 10,000 overlays
or whatever they want.
We have demos and the feedback system for feedback. That's why I think guaranteed testing is way more valuable to people than getting ranked as 34th out of 68 maps or whatever. That's useless, but all the !fb and !gf feedback and demo recordings people get? Super useful.
For my argument, I may have not clearly stated or lost it in my longer post, so I'll clarify for everyone here. A better voting system will solve both problems: A better system will make voting for a large number of maps not a nightmare (for anyone). It will keep the voting period to a reasonable timeframe (max 3 weeks) and be designed in such a way that mappers can collect feedback and move on with development quickly. Ideally, the system allows for parallel development of maps immediately after the 72hr contest ends, without introducing any sort of update bias. I've already talked to Geit about things, and I think we can come up with some sort of system that does this, rather easily.
Parallel development is a bad idea, if those maps are allowed to be played, that's MORE maps seeing testing during the voting period, and if they aren't then the author has to sit on it and wait, which sucks for anything more than a few days.
Rather than talking to geit privately about a new system, describe it here and let us discuss it. Because if it doesn't slash the time taken to under 3 weeks to a month at max, then it's a change that isn't going to help things.
tl;dr: A better voting system will solve YM's complaint about not being able to develop maps during the voting period, while maintaining the competitiveness and voting of the contest. It'll make things easier for everyone and not force people to play 70 maps in a week.
Again I'll reiterate: describe the better system or throw your vote behind something someone has already described.
You've said "perhaps this" or "perhaps that" to wishy washy things. and said "more players" but that's not the issue here. It took me two months to get all 40 maps played last time. more people isn't going to help each of us play more maps. It'll just mean MORE people feel like they haven't played enough of the maps to fairly vote.
More people makes the situation worse. People don't feel happy casting votes until they've played a sufficient amount of the maps. For me, last time, that was all of them. Adding more people to the voting pool won't make it easier for me to play all of them, it'll make it harder if anything because it'll be harder to get onto the server. I had no problem rallying people last time to play the maps I needed to play, we did 10+ at a time and the server stayed full.
Number of people isn't the issue.
The google form is FUCKING AMAZING. It allows you to do some now and some later, to add votes and comments at a different time, allows you to update and change votes. It was the best.
Ease of casting votes, again, isn't the issue.
The issue is the number of maps there are to play and to cast votes on.
I'm firmly of the opinion that everyone should get the same amount of testing. I don't think we should be telling anyone that their map isn't good enough to be in the general running and I don't think making this event a contest is a good idea. It's just so wrong on every level.
For something like Ludum Dare, it makes sense. You make something over the weekend and then submit it for voting.
You're allowed to continue working on it, but due to the way testing happens for Ludum Dare entries there's never any confusion between your continued version and the one you submitted. it's impossible to confuse the two. So it's not a problem.
If you don't want to continue though, that's fine, the chances are you didn't even make your entry to be a viable product and were just doing a personal challenge to learn something new or just push boundaries. So just wait the voting period out and enjoy the feedback you get. yay.
For us though it's totally different. While people do enter the contest to push their boundaries and make something throwaway, I'd bet 90+% of us want to continue that map after the contest if it turns out to be any good.
But if you want to continue you've got problems because testing of the updated version and testing of the contest version would happen in the same space. So we disallow it.
We disallow people to work on their maps because some of us want this to be a contest
Think about how awful that is.
I'll reiterate: Suggest your method for making things easier so we can discuss it. If you can't propose a voting method that will reduce the time it takes down to 2-3 weeks then we really need to scrap the contest element of it and get back to the core of what this place is supposed to be about:
testing maps and helping people make their maps rather than hindering them.