1. Psst! We just published some cool documents with tons of tips and secrets about both this forum and Mekorama. Whether you're just visiting, a new member, or have been with us for a while, we're sure you'll find them useful. So far we have Welcome_to_MekoramaForum.pdf, Introduction_to_Mekorama.pdf, and How_to_Share_a_Mekorama_Level.pdf. Find them all in this forum thread:

    Everything you have always wanted to know about Mekorama

    Dismiss Notice
  2. Hi. This yellow notice is called a system notice. You can click on the tab of each (at the bottom right) to stop and read them. They can also be dismissed by clicking on the 'X' (in the top right corner). From time to time we may refresh them (make them visible again) as a reminder to all the members. And if you ever want to read one that has been dismissed, you can do so via this thread in the Announcements forum. Thank you for respecting them!
    Dismiss Notice

Statistics Levels statistics - Research for monthly reports

Discussion in 'Notable Levels' started by Gepeto, Oct 6, 2016.

  1. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    EDIT @ 10/18/2016 - I have changed the name of this topic as it was first intended to be a simple report of stats for september 2016 from the website itself. Eventually it turns into a real statistic methodology dicussion because of the competences of members arround. That's great as it is now possible to rank levels according to several criteria importances and not only each of them separatly. I will publish some results/threads for the last couple of monthes (for history) before regular and monthly releases.
    __________

    At the end of August @vince started a thread about sorting levels on a specific date range. I really loved that! (Thanks Vince!). More than one month after I think it could be great to do that each month. Originally I have posted that on the previous thread but it is maybe more relevant and organised in a special thread.

    As one post cannot have more than 10000 characters I am going to do that in several parts.

    So Here are the stats for september (well... much more now), from the 09/01/2016 to the 10/06/2016 included (MM/DD/YYYY). You can click on the links of the titles for a direct access :)

    ____________________
    20 most viewed

    TitleAuthorViewsRateLikesCommentsDate
    1Praying For RainnGord1K315810/02/2016
    2Deserted Cursemeko650322309/20/2016
    3Opening Doorsmeko604742209/12/2016
    4The Mountainmeko590342109/09/2016
    5Limborichardfu_5871041409/02/2016
    6Begin Againmeko564322009/05/2016
    7HeadroomZachMan56201009/08/2016
    8Transformers (re)Gepeto500312109/07/2016
    9Glyph Walkrichardfu_4961131909/16/2016
    10No way to WinTR O494532909/12/2016
    11Special Forces Vol IS. Nagy468411909/04/2016
    12Padlock Game v2TR O467302809/18/2016
    13OOOOOOO SCAAARYYYYY!!!!Scare Crow419002409/21/2016
    14Expedition IVrichardfu_4061011609/12/2016
    15STEPPING UPMike_CN387002409/24/2016
    16CastleKPACABA371011109/11/2016
    17Choicemeko357721910/03/2016
    18Mountain Depthrichardfu_353751009/10/2016
    19Expedition IIIrichardfu_35393909/06/2016
    20Cursed Towerrichardfu_343201109/06/2016
     
    Last edited: Oct 18, 2016
  2. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    20 most commented

    TitleAuthorViewsRateLikesCommentsDate
    1Praying For RainnGord1K315810/02/2016
    2No way to WinTR O494532909/12/2016
    3Padlock Game v2TR O467302809/18/2016
    4STEPPING UPMike_CN387002409/24/2016
    5OOOOOOO SCAAARYYYYY!!!!Scare Crow419002409/21/2016
    6Deserted Cursemeko650322309/20/2016
    7Opening Doorsmeko604742209/12/2016
    8SwampKhudrat223502110/05/2016
    9The Mountainmeko590342109/09/2016
    10Transformers (re)Gepeto500312109/07/2016
    11Begin Againmeko564322009/05/2016
    12Choicemeko357721910/03/2016
    13Glyph Walkrichardfu_4961131909/16/2016
    14Special Forces Vol IS. Nagy468411909/04/2016
    15Super Mario Bros V3sawdust316521809/30/2016
    16Crouching TigerTR O316841709/27/2016
    17Plan BLooKing?220401609/23/2016
    18Expedition IVrichardfu_4061011609/12/2016
    19Mini Outpostrichardfu_3371311510/03/2016
    20Flippedsawdust247211509/23/2016
     
    TR O likes this.
  3. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    20 most rated

    TitleAuthorViewsRateLikesCommentsDate
    1Mini Outpostrichardfu_3371311510/03/2016
    2Glyph Walkrichardfu_4961131909/16/2016
    3Path of Couragerichardfu_3281021309/30/2016
    4Expedition IVrichardfu_4061011609/12/2016
    5Limborichardfu_5871041409/02/2016
    6Dark Watersrichardfu_238931010/02/2016
    7Expedition IIIrichardfu_35393909/06/2016
    8Crouching TigerTR O316841709/27/2016
    9Choicemeko357721910/03/2016
    10Claw Machine BoxTR O274711210/01/2016
    11Chateau Sawdustsawdust22073809/23/2016
    12Opening Doorsmeko604742209/12/2016
    13Mountain Depthrichardfu_353751009/10/2016
    14Ship Pickingrichardfu_17262509/27/2016
    15Expedition Vrichardfu_27362709/22/2016
    16Fishingrichardfu_25463709/18/2016
    17SwampKhudrat223502110/05/2016
    18Jump pipeMuslim Arizzy154511110/02/2016
    19Super Mario Bros V3sawdust316521809/30/2016
    20SudokuMScript161521009/28/2016
     
    chemi and TR O like this.
  4. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    20 most liked

    TitleAuthorViewsRateLikesCommentsDate
    1Mountain Depthrichardfu_353751009/10/2016
    2Ancient TempleLazarus14615109/04/2016
    3Safebreaker2cheinz7444410/02/2016
    4RailsMScript11634509/29/2016
    56 Piece Burrsawdust14244409/28/2016
    6Crouching TigerTR O316841709/27/2016
    7Opening Doorsmeko604742209/12/2016
    8The Mountainmeko590342109/09/2016
    9Limborichardfu_5871041409/02/2016
    10Dark Watersrichardfu_238931010/02/2016
    11Electric CuteLooKing?13733609/30/2016
    12A lofty goalJose Luis Galiano13723609/30/2016
    13Chateau Sawdustsawdust22073809/23/2016
    14Cae11Chuckthulhu19253909/19/2016
    15Fishingrichardfu_25463709/18/2016
    16Glyph Walkrichardfu_4961131909/16/2016
    17SwivelMuslim Arizzy193331309/13/2016
    18Manage Your TimeMuslim Arizzy7923109/12/2016
    19No way to WinTR O494532909/12/2016
    20Screenshot_2016-09-08-23-01-41-47Muslim Arizzy17253409/08/2016
     
    TR O likes this.
  5. cpw

    cpw Weekend Moderator Staff Member

    Messages:
    236
    Levels:
    64
    Albums:
    4
    Likes Received:
    660
    Joined:
    Jun 5, 2016
    Nice statistics. @richardfu_ basically owned half of the Most Rated chart :D

    I always find it interesting that the most viewed/commented levels are usually either about astonishing bugs (the wow factor), or have uncertainties (i.e. too hard, or solvable in many ways) that open the door to a lot of discussions (but not necessarily ratings). The most rated ones however usually have a clear direction, are solvable by most people, and often action-packed (because @richardfu_ :rolleyes: ).
     
    richardfu_, nGord and vince like this.
  6. vince

    vince Well-Known Member

    Messages:
    56
    Levels:
    38
    Albums:
    1
    Likes Received:
    605
    Joined:
    Jun 27, 2016
    I agree, many levels get a lot of views for bad reasons.
     
    cpw likes this.
  7. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    That's interesting. Here is how I see things:
    • the most commented = there's something to speak about
    • the most viewed = there's something interesting to see
    • the most rated = there's high quality content
    • the most liked = there's something... to like :)
    To me, "the most viewed" means something relevant where "the most commented" could be tendencious. But I agree that "the most rated levels" is more relevant than anything. On the other hand I've seen a default in the rated method: it doesn't take care of the ratings. So you could have 20 rates for a level with a rating of 3 :eek: Fortunately , for real, levels are rated when people prefer to add a positive rating. But the prefered way to consider ratings should be an equation with rates and ratings (if you've got an idea on that tell me ;))

    Everything is based on the orders proposed by the website for each category. It could be better with an access to raw data (base) but it is not possible. Maybe I'll try to figure out the rating more than just the number of rates but that's less obvious to code as it needs to reorder everything with this new result not just from what the website tell us on that.

    Otherwise, maybe someone could find an algorythm that I can use to melt all the data and build a chart of the 20 best levels of the month?
     
    cpw likes this.
  8. vince

    vince Well-Known Member

    Messages:
    56
    Levels:
    38
    Albums:
    1
    Likes Received:
    605
    Joined:
    Jun 27, 2016
    What I have done is counting the total number of stars, that is to say number of ratings multiplied by rate. It gives a better idea than the average rating. The number of views is not very relevant. By the way, I always wondered how hundreds of people can view a level without rating or writing a small comment. I think at most 10 guys give rates to levels in the forum...
     
    Last edited: Oct 7, 2016
  9. cpw

    cpw Weekend Moderator Staff Member

    Messages:
    236
    Levels:
    64
    Albums:
    4
    Likes Received:
    660
    Joined:
    Jun 5, 2016
    Many are probably just visitors and don't even bother to register. They are just looking for more content and have no interest in discussing or studying the physics of Mekorama :(
     
    vince likes this.
  10. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    @vince From what I have understood you was parsing also the number of rates, not the rating number, isn't it?
    [​IMG]
    There's a difference between them because the "ratings stars" (red frame on the picture above) is not the same than the rating notation (shown by the arrow) . Maybe (rates x ratings) = valuable notation? But then we could have (3 rates x 5 ratings = 15) < (10 rates x 2 ratings = 20) witch is bad... :(

    I don't know how the views are counted as many time I came to a level without downloading and nothing changes in the views count (at least on the moment). The same when I download it. Maybe there's some delay.

    Many people just come and download I think. They are not obliged to rate so, that's part of the deal o_O Maybe some don't even speak english. My kid used to came to the website on my back but he doesn't read english (french is coming soon :p), so no need for that. What we don't know is if a downloader needs to be registered to count as a view. Otherwise, to rate people needs to be registered. Maybe that's the point :rolleyes:
     
    vince likes this.
  11. sawdust

    sawdust Moderator Staff Member

    Messages:
    150
    Levels:
    83
    Albums:
    4
    Likes Received:
    691
    Joined:
    Jun 8, 2016
    Well, I like math so I applied some math to the view to rating ratio. If you look at the "Members Online Now" section of the homepage, you will notice that most of the time there are about 3x as many guests as members at any given time so we can reasonably estimate that about 3/4 of views are from guests. Those are views that CANNOT leave ratings unless they sign up. Also, not all views necessarily mean downloads, not all downloads mean wins, and not all wins mean ratings. We have about 4 filters in between views and ratings that can be summed up with the following formula.

    (Ratio of member views to guest views) x (ratio of downloads to views) x (ratio of wins to downloads) x (ratio of ratings to wins) = percent of views that return a rating.

    Let’s assume 25% of views are members, 50% of views are downloads, 75% of downloads are wins, and 25% of wins are ratings.

    .25 * .5 * .75 * .25 = 2.3% of views can reasonably be expected to ratings.

    Note that downloads, wins, and ratings are complete guesses based on members only, NOT guests since they were counted out in the first ratio. I also believe the estimated ratios I put are pretty optimistic. If someone else knows how to get these actual stats that would be awesome, but I’m not a web guru like @vince and @Gepeto ;-)
     
    vince, Gepeto and cpw like this.
  12. vince

    vince Well-Known Member

    Messages:
    56
    Levels:
    38
    Albums:
    1
    Likes Received:
    605
    Joined:
    Jun 27, 2016
    @Gepeto
    That is exactly what I have done. It is not so bad because as you said, 2 stars ratings are extremly rare.
     
    Gepeto likes this.
  13. cpw

    cpw Weekend Moderator Staff Member

    Messages:
    236
    Levels:
    64
    Albums:
    4
    Likes Received:
    660
    Joined:
    Jun 5, 2016
    Because you know......People would rather give 1-star ratings right away if they dislike a level so much :rolleyes:
     
    Gepeto and vince like this.
  14. B Hill

    B Hill Active Member

    Messages:
    63
    Levels:
    24
    Albums:
    3
    Likes Received:
    233
    Joined:
    Jul 28, 2016
    Oooh, now we are getting into territory I am familiar with. I have used statistical quartiles to rank applications based on a combination of metrics- total number of launches, total application running time, date of the very first launch, date of the most recent launch, time elapsed between launches, etc. The key to this analysis is normalization- and guess what? The website already provides you the normalized data! Woohoo!
    Let me explain- the website already gives you a ranked list of levels based on different criteria- rating, number of views, number of comments, etc. For each criteria, you can take each list and break it down into quartiles. For example let us say there were 100 levels uploaded in the last month (to make math easy). To split these into 4 quartiles, quartile 1 (Q1) is levels 1 to 25, Q2 is levels 26 to 50, Q3 is levels 51 to 75 and Q4 is levels 76 to 100. Assign each quartile a score- Q1 would be 4 points, Q2 3 points, Q3 2 points and Q4 no points. Do this for each criteria and add up the points for a total score. Example:

    My Level1- lots of views and ratings, OK average rating, not many comments
    Code:
    Criteria Type:  Views    Rating      #Ratings     #Comments
    Quartile:         Q1        Q2         Q1          Q4
    Scores:            4         3          4          0
    Total score=11
    My Level2- low number of views, rating and comments, but high average rating:
    Code:
    Criteria Type:  Views    Rating      #Ratings     #Comments
    Quartile:      Q3          Q1          Q3           Q3
    Scores:        2           4           2           2
    Total score=10
    So in this example, My Level2 has a very high average rating, but not much activity (views, comments, number of ratings) on the level. It has an overall score just below my other Level1 that had a slightly lower average rating but much more activity.

    I could probably whip up a spreadsheet showing an actual example if you have the complete ranked lists of levels for the last month.
     
    Last edited: Oct 7, 2016
    cpw, Gepeto and sawdust like this.
  15. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    Wow... I do love this conversation :cool: For now I am back to coding to get the whole data over a range of dates, but of course, everything is from "now" :rolleyes:. So I do not take just the 20 of each categories given from the website, but I am grabbing all data in a range in order to do whatever I want with that (I'll check if I come to the same result than the website :p). So @sawdust and @B Hill your advices are really precious. @B Hill I would not be surprised that you work in a Big Data company ;)

    I'll dig on math and stats and let you know. For now I try to end up something good with the data :D
     
  16. B Hill

    B Hill Active Member

    Messages:
    63
    Levels:
    24
    Albums:
    3
    Likes Received:
    233
    Joined:
    Jul 28, 2016
    OK here is a spreadsheet I whipped up. I used the data above with the 20 top Levels in each of 4 categories. What this really represents is activity on the levels, since the actual star rating for each level is not available. But this gives a very good picture of the most active levels above. The first table is the raw quartile scores, scroll down in the page to see the final ranked scores.
    Mekorama Levels Scored by Quartiles

    OpenOffice version
     
    Last edited: Oct 7, 2016
    TR O likes this.
  17. B Hill

    B Hill Active Member

    Messages:
    63
    Levels:
    24
    Albums:
    3
    Likes Received:
    233
    Joined:
    Jul 28, 2016
    If you can't view the file above here's the final result:

    Final ranking: Title Author Total score

    Opening Doors meko 12

    Limbo richardfu_ 11

    The Mountain meko 10

    Glyph Walk richardfu_ 10

    Praying For Rain nGord 8

    No way to Win TR O 8

    Deserted Curse meko 7

    Expedition IV richardfu_ 7

    Mountain Depth richardfu_ 7

    Crouching Tiger TR O 7

    Transformers (re) Gepeto 6

    Padlock Game v2 TR O 6

    OOOOOOO SCAAARYYYYY!!!! Scare Crow 6

    STEPPING UP Mike_CN 6

    Choice meko 6

    Dark Waters richardfu_ 6

    Begin Again meko 5

    Mini Outpost richardfu_ 5

    Special Forces Vol I S. Nagy 4

    Expedition III richardfu_ 4

    Swamp Khudrat 4

    Path of Courage richardfu_ 4

    Chateau Sawdust
    4

    Ancient Temple Lazarus 4

    Safebreaker2 cheinz 4

    Rails Mscript 4

    6 Piece Burr sawdust 4

    Headroom ZachMan 3

    Super Mario Bros V3 sawdust 3

    Claw Machine Box TR O 3

    Fishing richardfu_ 3

    Ship Picking richardfu_ 2

    Expedition V richardfu_ 2

    Electric Cute LooKing? 2

    A lofty goal Jose Luis Galiano 2

    Cae11 Chuckthulhu 2

    Castle KPACABA 1

    Cursed Tower richardfu_ 1

    Plan B LooKing? 1

    Flipped sawdust 1

    Jump Pipe Muslim Arizzy 1

    Sudoku Mscript 1

    Swivel Muslim Arizzy 1

    Manage Your Time Muslim Arizzy 1

    Screenshot_2016-09-08-23-01-41-47 Muslim Arizzy 1
     
  18. B Hill

    B Hill Active Member

    Messages:
    63
    Levels:
    24
    Albums:
    3
    Likes Received:
    233
    Joined:
    Jul 28, 2016
    I do not, I work in healthcare, on the IT side.:cool: But I program for Haiku OS in my spare time.
     
    Last edited: Oct 8, 2016
    TR O likes this.
  19. Gepeto

    Gepeto MekoStudio Architect, French Moderator Staff Member

    Messages:
    397
    Levels:
    48
    Albums:
    1
    Likes Received:
    2,097
    Joined:
    Jul 7, 2016
    I was reminded of Quartiles on Wikipedia :D @B Hill according to your sheets this method seems relevant. So I am digging on the subject to try to implement something in my code. I didn't get yet what decides the score you assigned to each quartile.
     
  20. Astral_Mage

    Astral_Mage Well-Known Member

    Messages:
    137
    Levels:
    38
    Albums:
    5
    Likes Received:
    427
    Joined:
    Jul 28, 2016
    Reputation plays an important role in the statistics as it seems, but it makes sense though :3
     

Share This Page