Maps and the comments they get

Terr

Cranky Coder
aa
Jul 31, 2009
1,590
410
Well, I WAS toying around with ANTLR to try to make a VMF lexer/parser... :p 'Cept I've forgotten it all and need to re-read the book.

When I go and look at a map in detail like that, I'm toggling things like displacements and func_detail and wireframe modes on and off in the console. I don't know how well those work on a multiplayer server with sv_cheats 1, let alone how people would react joining their favorite server and finding everyone zooming around with "don't hurt each other" rules.

That said, I think there's an opportunity there for a SourceMod plugin that provides a quick no-console-knowledge-needed menu for map investigation methods.
 
Last edited:

Psy

The Imp Queen
aa
Apr 9, 2008
1,706
1,491
I've given up all hope in the maps forum. Really, the only source of feedback I get is in-game or through STV. People are just lazy or couldn't give a toss. I mean, look at Void's map, his thread is pretty much one long monologue.
 

Zwiffle

L6: Sharp Member
Jun 24, 2008
269
161
Well I try to offer useful feedback (take pics, highlight areas I think need work) etc as much as I am able, but the problem is it takes a lot of time to write a wall of text and phrase everything you mean to say in such a way that's helpful, clear and isn't ambiguous . While I know a lot of people get feedback in-game, which is good, I tend to like to reflect over the play experience, and take some more time going over the layout.

I also try to limit which maps I play - I'd like to spend time on all of them but that's just not possible. I generally stick to maps that I am interested in, because hey, if I'm going to help out a map it might as well be one that I like.
 

Terr

Cranky Coder
aa
Jul 31, 2009
1,590
410
The problem with the maps forum is there's no easy way to tell which maps are ready for that kind of "func_detail that thing there" critique without trying to stay current on all of them. Even if the map is at that stage, you don't know whether the mapper has fixed or removed it all in their next-unreleased-build anyway.

Which is why I think some sort of managed "Singleplayer Review Requests Of The Week" thread could be helpful.
 
Last edited:

MangyCarface

Mapper
aa
Feb 26, 2008
1,626
1,325
Feedback is just a crutch until you know what to look for yourself. At that point, it's better to seek out individuals' feedback, those you know to have well-formulated ideas, or server operators who have run your maps in the past. You can't beat your own judgment in the majority of areas.

The mapping section is more for publicity, a dl location, and clipping/entity/optimization error reports and user requests IMO
 
Last edited:

Dr. Spud

Grossly Incandescent
aa
Mar 23, 2009
880
855
Feedback is just a crutch until you know what to look for yourself. At that point, it's better to seek ought individuals' feedback, those you know to have well-formulated ideas, or server operators who have run your maps in the past. You can't beat your own judgment in the majority of areas


Um...

I think you should interview at a development company, and explain to them how player-feedback is useless. You'll get that job for sure.
 

grazr

Old Man Mutant Ninja Turtle
aa
Mar 4, 2008
5,441
3,814
Um...

I think you should interview at a development company, and explain to them how player-feedback is useless. You'll get that job for sure.

That sort of playtesting is en masse bug finding.

The sort of feedback we're talking about is design based. Not "LOL, U GOT ERROR".
 

DJive

Cake or Death?
aa
Dec 20, 2007
1,465
741
I would agree. Having submitted my map for 2 game days so far and also playtesting and having been there for a few gamedays..

Feedback in general is hard to find.

What used to be play-testing has turned into just playing.
What used to be Critique has turned into general chat.

We used to have gamedays for mappers to TEST map and help give back feedback, now it seems like it's used as a get together for people who are sicking of mapping and want to play. While there is nothing at all wrong with this IMO that is not what the gamedays are meant for.

I and many/all of you like to use it for feedback. We are all in steam chat day after day, hour after hour... talking about the latest patch or the *GASP* hats and weapons we do none stop in chat... for what reason do we need to bring it into the gameday =p

For mappers to rush to try to secure a spot on a gameday.. staying up later then they should making all the fixes, getting last minute comments in etc.. and having an excitement for that up coming gameday.

That gameday comes and its full of 28 minutes of hats/weapons/zomgs and 2 minutes of feedback that consists of "its to dark" or "needs signs".

Its really discouraging.

Lets all as a community that was built on helping, lets all go back to this root. Sure there is an abundance of maps, but this doesn't mean you cant comment on them, I'm sure EVERY mapper here checks his thread each day or every few hours hopping they have a comment on there newest screenshots or updated build.

Communitys work on Karma :D , lets get that rolling again.
 

Dr. Spud

Grossly Incandescent
aa
Mar 23, 2009
880
855
That sort of playtesting is en masse bug finding.

The sort of feedback we're talking about is design based. Not "LOL, U GOT ERROR".

That kind of feedback is not only bug finding. I playtested Uncharted 2 this summer, and it wasn't to find bugs. The developers wanted to know what areas I found fun, frustrating, etc. Nobody at the company knew me before hand, but they definitely noted what I (and the other testers) remarked on.

There is a difference between feedback and suggestions. I would agree that, yes, a good mapper should rely on himself before others when he is coming up with solutions for a problem. When someone I don't know suggests "you should add a path here," it's not necessarilly something I need to do.

But when people I don't know give me feedback, which would be something like "this area isn't fun," how can I ignore that? Here's an example:

I playtest my map with 100 people I don't know. I think the map is fun. But lets say 90 of them say one area is not fun at all, and they wanted to quit. From what you're saying, Mangy, their feedback isn't useful. And I think that's ridiculous.

Maybe you can apply there too, and tell them that you're an asshole straight off the bat so they don't have to find it out later

Careful who you call an asshole dude. In your previous post you basically gave a giant "FUCK YOU" to everyone who left feedback on your maps.
 
Last edited:

Zwiffle

L6: Sharp Member
Jun 24, 2008
269
161
Mass playtesting isn't just to find bugs as Dr. Spud said. I know because I'm a professional level designer. We get everyone in the company to play all the maps and offer feedback, and that makes the level design process more focused and helps eliminate problems in layout and gameplay. Then later on when we get other play testers we take their feedback seriously as well. To limit yourself to your own feedback is downright narrow minded.

I'm not saying that you shouldn't trust your own opinion, but to say "I don't need to test because other players don't know what they're talking about" (paraphrasing) is too damn arrogant to be taken seriously and shouldn't be taken seriously. Feedback is an integral part of the level design process, period.
 

drp

aa
Oct 25, 2007
2,273
2,628
Mass playtesting isn't just to find bugs as Dr. Spud said. I know because I'm a professional level designer. We get everyone in the company to play all the maps and offer feedback, and that makes the level design process more focused and helps eliminate problems in layout and gameplay. Then later on when we get other play testers we take their feedback seriously as well. To limit yourself to your own feedback is downright narrow minded.

I'm not saying that you shouldn't trust your own opinion, but to say "I don't need to test because other players don't know what they're talking about" (paraphrasing) is too damn arrogant to be taken seriously and shouldn't be taken seriously. Feedback is an integral part of the level design process, period.
i dont think anyone has said to only take your feedback. but that your view and opinions should be considered first before anyone elses. and to me, it makes sense as you are the creator and visionary of that map. nobody knows what the final product should look/play like but you.

if you dont mind me asking, for what company do you work for? if you wish to not post it in public, a pm will do nicely. if not, no worries.
 

Fraz

Blu Hatte, Greyscale Backdrop.
aa
Dec 28, 2008
944
1,152
Feedback is hard to find. I think maps in beta stages however, should be pushing for their map to get public. Distributing, trying to get it on as many servers as possible. Feedback, I feel, should also be aimed more at alpha maps that need it more. Beta maps generally have feedback given, and are minor bugs/small gameplay tweaks such as ammo & health placement. Beta maps will get more tests on servers run by gaming communities, if they are promoted enough.
 

J4CK8

L11: Posh Member
Mar 4, 2009
820
243
Another thing that would help, is if people were told where their map was being played. After googling one of my maps, I found several results for community sites that had had my map on the server at one point. But most TF2 players are just playing the game and don't seem to care about your map progress at all.
 

Zwiffle

L6: Sharp Member
Jun 24, 2008
269
161
I would like to point that sometimes you might want to restrict specifically what you want tested - for example if you're making a GravelPit style map, and the defensive team always defends A but the offensive team always goes B you're not really getting a good testing of how easy/hard it is for one team at B. Saying "Hey, please defend and attack B this round" can provide a lot of feedback for what you're trying to test, as in this case no one can really comment on point B and how it plays.

I was thinking of doing something like this with the community TC/Koth map, just testing one stage at once so people can get more familiarized with a specific level instead of getting a really brief overview of the whole thing. That could theoretically benefit the feedback process.
 

MangyCarface

Mapper
aa
Feb 26, 2008
1,626
1,325
Pretty much what drpepper said, but:

I never said anything in regards to playtesting. It is integral, should be done often and be used to test your solutions. But 9 times out of 10 I am more interested in what the player is doing than in what they are thinking. Ask them what went through their mind at any one point, and the answer will often be too biased to be of any use.

I suggest to fellow mappers, once they've reached a certain level, to rely on demos, spectating, and playing themselves to experience weak points in their maps.

Sometimes you have to tell playtesters to shut the fuck up, not gonna lie. Nothing's funnier than hearing someone say I AM CONFUSED 10 seconds into set-up time. I almost always give the benefit of the doubt to the map.

I'll have more to say, and in a better organized fashion, at a later point.
 

UKCS-Alias

Mann vs Machine... or... Mapper vs Meta?
aa
Sep 8, 2008
1,264
816
You also need to know how the average player does check a map. They somewhat got a boolean mind. Its good or not good.

The reasons why they found a map bad or good is because they experienced only a few parts. Those parts stay in their mind and other ones become forgotten. Also, the class they play decides alot and the players that are in it. If you have the 2fort IR type of players they generaly call it bad because most maps try to prevent the 2fort sniper spam. However, a team with mindless rushers and fun players that dont care about winning might call it good. They havent however won a stage. And again, the comments are useless because you need a serious team for it.

This makes finding feedback that is usefull hard and therefor is rare. The best players which provide usefull feedback are the ones who do play for fun but still try to win. Luckily the gamedays got many of those players which makes it a very usefull source for feedback.

Another thing is bugtesting. Best is to do this BEFORE an actual alpha/beta release and best is to find expert rocket/stickyjumpers for it. Any bug found during a test will couse players to change the playstyle even though they dont notice it (they will peek to that corner too often not looking at the place they normaly would). A single test often isnt enough also as people dont know the routes that well that it's somewhat automatic. Luckily these are minor balance issues and they will be found later when some servers use the map on their main rotation and not just for a test.

Hoodoo suffered from the last. It did have its playtests but with a limited type of players. It didnt have the randon 32 player IR type in its tests as there wasnt any server of those types willing to let their players download 70mb. As soon as it was released in a valve update the right feedback came to him and he already managed to massively improve stage 2 because of it. And im sure that before that map came in an update that he had alot of tests already (more than most maps).

The best indicator that your map is fun to play is when it starts to show up on servers more often. And best are the 32 IR servers for it. If your map works well on those servers they will work on allmost any other. (yes, respawn time tweaking is much easier to balance the map than editing the map). Hoodoo failed at that part and because of that recieved a very bad name.
I would like to point that sometimes you might want to restrict specifically what you want tested - for example if you're making a GravelPit style map, and the defensive team always defends A but the offensive team always goes B you're not really getting a good testing of how easy/hard it is for one team at B.
I disagree a bit with that. If the offenders allways go to B and the defenders to A you either have placed the spawns wrong where people dont notice A until B is capped (read cp_wolf) or it has been tested alot and the result is that A is harder to cap so red defends that one to make it even harder and guarantee a win and blue goes to B because thats some free extra time they recieve then. It would save them from some extra defence they would get if they capped A first.

in the first week of gravelpit defence was spreaded evenly also. Now allmost anyone goes B as defenders because its the easiest one to defend.

If you wait too long with fixing that you however are forced into locking 1 route or making them spawn facing that route where the other one gets somewhat forgotten so people will attack that point a bit more again. Then people will find out that the point indeed has changed and its easier again. The playtests in the next version are valuable again then.

Why do you think valve has over 100 iterations of a map? Because they want to fix those issues as fast as possible so people dont realy know which site is easier to attack and so spread out in a normal way.

Another thing, if people say the respawn times are too long then thats some valuable information. Dont ignore that as respawn times are something they will have to face all the time. There is however a chance of confusion. Sometimes the defenders have a respawn time of 30 seconds ingame but the map is balanced. In this case its often quite clear that they dont like the wait of 30 seconds even though its balanced. Sometimes its however 14 seconds and in that case there are 2 options they can mean. They dont like the waiting (in that case you can often ignore that because 14 seconds arent that long) or they are unable to defend the map. When they are unable to defend you however need to know how good the team actualy is in defending. Some others have already explained that part before and i dont bother to copy that.

The playtesting process is much more complex than most think.
 
Last edited:

Sgt Frag

L14: Epic Member
May 20, 2008
1,443
710
I agree with what Mangy said though. I do think you need to take comments with a serious grain of salt.

Every test I've had so far [current map] (in most I forgot or missed one crucial element that totally screwed gameplay) I've had completely different results with players.

Either they can't cap the first 2 points, or they steamroll. So some people think it needs to be easier, some harder. I deffinately can't make substantial changes that would make both those bases happy.
I had a comment that snipers were OP. Well, one player was getting pwned, probably by Ravidge (who was owning me in snowdrift). So I will look into that by watching demo, seeing where snipers are hanging, etc...
But I'm not gonna rush to make changes because one player got pwned (especially if it was by an expert sniper). I'll keep an eye on that as a possible problem though.
If it keeps coming up from different players it's an issue.

I think that's the point Mangy was making, not that feedback/playtests are useless. But that as a mapper you already need a decent idea of how each class works and how to balance around that. Then you take comments with a grain of salt, look into them but don't rush to changes until it shows itself as necessary.