Help - Forum Sort levels by views AND date ?

I don't know if you did that by hands but I hope not!
Your thread woke me up on my keyboard, so in case you (or others) are interested in, here is a Python3 code that can help in that way:

Code:

#!/usr/bin/python3
# BeautifulSoup needs to be installed with "pip install BeautifulSoup4"
# By Gepeto on 09/02/2016

import urllib.request
from bs4 import BeautifulSoup
from datetime import datetime

order = {
    'most commented':'comment_count',
    'most viewed':'view_count',
    'highest rated':'rating_avg',
    'most rated':'rating_count',
    'most liked':'likes'
    }
ordering=order['most viewed'] # Changing the order amongst the dict above

pages = range(1,300)
results_number = 20
from_date = datetime.strptime('08/01/2016', '%m/%d/%Y') # start Month/Day/Year
levels = []

print('Order:', ordering)
for page in pages:
    with urllib.request.urlopen('http://mekoramaforum.com/media/?order='+ordering+'&page='+str(page)) as response:
        html = response.read()
        soup = BeautifulSoup(html, "html5lib")

        # print('Page', str(page))
        for media in soup.find_all('div', attrs={'class': 'mediaContainer'}):
            level = {}

            author = media.find('a', attrs={'class': 'username'}).text
            level['author'] = author

            titleSection = media.find('a', attrs={'class': 'mediaTitle'})
            level['title']= titleSection.text.strip()
            level['url'] =titleSection['href']
    
            stats = media.find_all('div', attrs={'class': 'statCol'})
            stats_data = []
            for stat in stats:
                stats_data.append(stat.text.strip()) #.replace('K','000'))
    
            level['comments'] = stats_data[0]
            level['views'] = stats_data[1]
            level['likes'] = stats_data[2]
            level['rate'] = stats_data[3]
    
            date_str = media.find('div', attrs={'class': 'mediaLabel'}).text.strip()
            date_object = datetime.strptime(date_str, '%d %b %Y')
            level['date'] = date_object
    
            if date_object > from_date and len(levels) < results_number:
                levels.append(level) # Just for futures uses or results filtering
                print(str(len(levels))+'.', '"'+level['title'], '"\t', level['author'], '\tviews:', level['views'], '\trate:', level['rate'], '\tlikes:', level['likes'], '\tcomments:', level['comments'], '\tdate:', level['date'].strftime('%m/%d/%Y'))

        if not len(levels) < results_number:
            break

Sorry, no syntax highlighting possible...
It's not an improved script, just a simple one to get a quick result depending on filtering arguments.

 

OK... Good to know about this app. I'll give it try too

 

@TR O Haha I am not able to code a game such as mekorama but scripting with Python is not a big deal. It is more or less getting the html of a web page and seeking for some patterns to print them.
@vince I have tried Automate on Android and I am not sure that's the one you're speaking about... Nothing about parsing a web page or things like that

 

There's no proper way to do that. I just wanted to be be sure that you wasn't so desperate to have an answer that you did it by hands Otherwise I find really interesting to know more about other smart ways such like your. I'll dig on that.

 

@vince Thanks for sharing. That seems a really great app, as I like. I have downloaded your app but when I tried to launch it (begin mode or whatever) it asks me to get the purchase version of Automate and if I refuse, it goes back to the start menu of your app...

I have updated too my Python script (so I can do it as I want with it), but your app seems to be more friendly user so it is sad that I can't use it (unless I pay...)

 

@vince Thanks. I tried quickly but I need to take a more carafully look at Automate because it always asks me for permissions... I agree but the process fails. I met that too with a process I tried to build but thought of something weird I am missing. That's kind of a mekorama puzzle where I need to get to the win spot

 

Hi @vince!
As you may noticed I have first made an update of the stats for september here. Finally I have moved them to a new thread for a better organisation.
You are the one that started that! Thanks!

 

@B Hill - I plan to do that every month (I need to add a reminder on my phone... )

@vince - I hesitated first as it is your idea but, as everything is automated on my code to output with BBCode... I did it to me first, than I thought: "what a selfish guy I am! :mad:" . I gave up with the Automate app But coding it was fine to me.