TF2Maps Demographics and Skills Survey: RESULTS!

Discussion in 'Mapping Questions & Discussion' started by Fantasma, Jun 10, 2017.

  1. Fantasma

    aa Fantasma

    Messages:
    884
    Positive Ratings:
    979
    So, the questionnaire is done! The results are locked in! Wanna see some juicy stuff, you’ve come to the right place!

    The results!

    Graphs and summaries:

    https://docs.google.com/forms/d/15oYAwG60wfqULeKQ-K8SeSO2B4ozYO2TN1CEXgj4vnQ/viewanalytics

    Raw Data
    Inside the Zip file attached!

    Correlations analysis
    Inside the zip file attached!

    What does the color coding in the file mean?
    I’ve highlighted the Pearson correlation and significance within the excel document, this will serve as a guide to finding where significant links are. I’ve provided a brief explanation below as to what these values mean. Basically though the deeper the color, the more confident or stronger the correlation.

    Confidence:
    • Yellow: >10% Confidence
    • Orange: > 90% Confidence
    • Red > 99% Confidence
    Correlation
    • Blue > 0.25 Correlation
    • Deeper blue > 0.5 correlation
    Understanding Correlations of quantitative variables
    If you've completed statistics at university level, you can skip this.

    I did some quick analysis of quantitative variables against each other. Before I dump it all on you I feel as though it’s important to explain what exactly is going on for those unfamiliar with stats.

    Correlation: This means the DIRECTION and STRENGTH of the correlation.
    • -1 is a negative correlation (The higher one variable goes, the lower the other goes)
    • -0.5 is a moderate negative correlation
    • 0 is no correlation
    • 0.75 is a strong positive correlation
    • 1 is a positive correlation (The higher one variable goes, the higher the other one goes)
    Significance: The value represents the likelihood that the results came out the way they did purely because of chance. So, the smaller this value, the better.
    • 0.10 would mean we are 90% confident in the correlation
    • 0.05 would mean we are 95% confident in the correlation
    • 0.01 would mean we are 99% confident in the correlation
    So, if we had to piece it all together. Let’s say we have a correlation of -0.25 with a significance of 0.10

    There is a 90% confidence that the variables have a weak negative relationship.

    Confused? I sure am, I have an exam in two weeks. Anyways, here’s a table of some juicy bits.

    Some interesting correlations:

    Capture.JPG
    There's more to checkout in the excel file in the zip folder if you want to get into the nitty gritty of it, unfortunately it'd be too much for me to get into one image unfortunately (if someone can, send me the picture and i'll ad it here).

    Other tidbits

    Before I’m asked if I can do more analysis on the data, for more correlations. I’ve decided I’m going to leave it at this for a few reasons:
    • It will take a long time for something that I’m pretty inexperienced doing
    • In a lot of instances inference can’t be performed because the sample sizes aren’t large enough
    • Some questions were misunderstood, making it unfair to make inference on TF2Maps as a whole
    All the gmail logins are, were, and never will be made public or even viewable by me.

    If you found something interesting in the data, I will add it to this post.
     

    Attached Files:

    • Thanks Thanks x 2
  2. Fantasma

    aa Fantasma

    Messages:
    884
    Positive Ratings:
    979
    Before they're lost forever, here's the sample pictures provided
     

    Attached Files:

    • 01.JPG
      01.JPG
      File size:
      45 KB
      Views:
      64
    • 02.JPG
      02.JPG
      File size:
      35.3 KB
      Views:
      64
    • 03.JPG
      03.JPG
      File size:
      47.2 KB
      Views:
      63
    • 04.JPG
      04.JPG
      File size:
      47.5 KB
      Views:
      65
    • 05.JPG
      05.JPG
      File size:
      35.8 KB
      Views:
      67
    • Thanks Thanks x 1
  3. Freyja

    aa Freyja ¯\_(ツ)_/¯

    Messages:
    2,843
    Positive Ratings:
    4,778
    [​IMG]

    Ya'll need to finish some freaking projects!!
     
    • Agree Agree x 9
    • Funny Funny x 3
    Last edited: Jun 10, 2017
  4. Lampenpam

    aa Lampenpam

    Messages:
    1,019
    Positive Ratings:
    337
    Is it that you vote automaticly for 0, when you don't vote at all? I never used the _a, _b, _rc system, perhaps others did too?
     
  5. Freyja

    aa Freyja ¯\_(ツ)_/¯

    Messages:
    2,843
    Positive Ratings:
    4,778
    No, all questions were optional, 83 people chose to vote on it, there were 90 total responses to the survey
     
  6. Asd417

    aa Asd417 L1: Registered

    Messages:
    804
    Positive Ratings:
    560
    캡처.PNG
    Really? but theres nothing to optimize...
     
    • Respectfully Disagree Respectfully Disagree x 6
  7. Nicky

    aa Nicky Lets try something new!

    Messages:
    912
    Positive Ratings:
    1,698
    Well when I make my alphas I think about how my skybox is going to work, how sightlines are going to work (which can affect gameplay and optimization), and stuff like that. I may not constantly put area portals in my map during alphas, or worry about working with hint and skips, but just knowing how you can and will optimize for the later stages when the map gets more bloated with detail is very helpful.

    Mapping isn't just making what you need now, but it's also preparing for the future. If you think ahead about this stuff, and just have some general ideas how you will optimize for more detailed and laggy versions, I guarantee you will have a much easier time mapping, and get less complaints about fps in later stages.

    Also some alpha maps sometimes have a bit of detail or are just really big, and if I have to render every bit of that map at every second I'm gonna fucking shit. As someone without a good computer, optimization is very important to me. I'd much rather play a game that's mediocre or not the most fun, but has great performance, rather than a game that is praised by many but won't even run on the stuff I have.
     
    • Agree Agree x 10
    • Thanks Thanks x 1
  8. henke37

    aa henke37

    Messages:
    1,878
    Positive Ratings:
    442
    Who is the joker who made a negative number of maps?
     
    • Agree Agree x 1
    • Funny Funny x 1
  9. Asd417

    aa Asd417 L1: Registered

    Messages:
    804
    Positive Ratings:
    560
    Much to learn, I have.
     
  10. BigfootBeto

    aa BigfootBeto Too obsessed with perfection

    Messages:
    369
    Positive Ratings:
    561
    In hindsight, I should've suggested the question "Are you a nerd?" (even though the answer is quite obvious)
     
    • Funny Funny x 1
  11. Cytosolic

    Cytosolic L4: Comfortable Member

    Messages:
    187
    Positive Ratings:
    150
    It was pretty neat looking though the stats. Thank you for compiling the data and posting the results.
     
  12. Fr0Z3nR

    aa Fr0Z3nR Creator of blackholes & memes. Destroyer of forums

    Messages:
    6,391
    Positive Ratings:
    4,906
    Dear Fanta,

    Please make sure that axes are labeled properly.

    Thanks,
    Your probably 4th grade science teacher (and me)
     
    • Agree Agree x 2
  13. Fantasma

    aa Fantasma

    Messages:
    884
    Positive Ratings:
    979
    What do you mean by this? I've not made any graphs myself.
     
  14. LeSwordfish

    aa LeSwordfish semi-trained quasi-professional

    Messages:
    4,106
    Positive Ratings:
    6,006
    0 people have made 69 maps reach RC.
     
    • Funny Funny x 3
    • Like Like x 1
  15. Hotel Detective

    Hotel Detective L4: Comfortable Member

    Messages:
    187
    Positive Ratings:
    189
    Here you go I fixed it
    steve.png
     
    • Funny Funny x 13
    • Like Like x 2
    • Thanks Thanks x 1
  16. Fr0Z3nR

    aa Fr0Z3nR Creator of blackholes & memes. Destroyer of forums

    Messages:
    6,391
    Positive Ratings:
    4,906

    You have graphs. Your axes need labels to show what they represent. Is that 0 Pyro's burned 69 spies? How am I supposed to know?

    Or, as like LeSwordfish said.
     
  17. Hotel Detective

    Hotel Detective L4: Comfortable Member

    Messages:
    187
    Positive Ratings:
    189
    Here's a visual representation:
    tusmco.png
    I should have labeled this Votes / Maps Finished or whatever but that's the general gist.
     
    • Thanks Thanks x 1
  18. Fr0Z3nR

    aa Fr0Z3nR Creator of blackholes & memes. Destroyer of forums

    Messages:
    6,391
    Positive Ratings:
    4,906
    Yea

    Do this. This is graph making 101.
     
  19. Idolon

    aa Idolon the worst admin

    Messages:
    1,519
    Positive Ratings:
    4,332
    The questions could be better phrased (especially on the questions that ask you to rate on a 0-10 scale), and maybe it would be better to show these as histograms dot plots instead of bar graphs, but I don't think you need to be this particular when the vertical axis on every single graph is voters. It honestly never occurred to me that the graphs would be read any other way.

    EDIT: Turns out a histogram is just a particular type of bar graph. I was thinking of a dot plot.
     
    • Thanks Thanks x 1
    Last edited: Jun 12, 2017
  20. Fantasma

    aa Fantasma

    Messages:
    884
    Positive Ratings:
    979
    Then email google and tell them this, because they made the graphs.

    Google forms basically does a "hey we'll make a graph of each question" thing after a survey, which I linked here.