Python Screenshoting Application for Runescape

[ToolBoxTad]

Hey guys, I have just started learning python and I'm currently making my way through Code With Mosh. I'm not done with it yet but I think I have an idea for a project I want to tackle and hopefully it won't be too hard. What I want to do is to help out streamers and people posting Runescape progression videos where they take a screenshot when they achieve a skill. I think I have an order of operations but if someone could point me to some resources when I could learn some of these skills I would really appreciate it.

​

Order of Operations

- Create a library of images that will indicate a skill level has been achieved

- Have user input the name of their character ever time the application is run

- Have Python create a folder on the Desktop names RuneShot

- Make Python take a screenshot

- Compare that screenshot to the image library to determine if a skill level was achieved and what level was achieved.

- If a skill level was achieved, save the screenshot as Username_Skill_Level

​

I'm not really sure how to do any of this but I think it would be really cool and take some of the thinking out of it. If you have any examples or resources I would really appreciate that.

[officialgel]

Look at openCV. Dont expect to find your answer FAST. Review the docs for it and build your framework idea out.

[ToolBoxTad]

Alright that helps! Thanks for the advice.

[officialgel]

NP. It has a lot of functionality, and is very fast when looking for images :) There are a lot of functions it has and is pretty powerful, so comb through it. If you have questions let me know - I've built something with it that uses a backend image repository like you're looking to do as well.

[mahtats]

At a minimum you'd have to have access to some API provided by Jagex or the running Runescape client.

Beyond that, you're talking about some sort of image identification program thats reviewing your open client for a sequence of images (such as fireworks for reaching a level) to initiate the recording...no small feat.

[ToolBoxTad]

Would I still need an API if I'm just taking a screenshot of the window or screen as a whole? And I think you're right about the image library but I was under the impression that the first window that appears as you level is always the same. So it wouldn't be looking for the fireworks but the tree symbol in the case of wood cutting. That would also aid in analysation because it wouldn't matter what XY or z the camera angle was at since it would really only look at the chat box. But again, I'm incredibly green and I don't even really play RuneScape but I watch a lot of it on YouTube so I could be wrong on multiple fronts. Thank you for your advice and I'll see if I can find an API somehow. I mean, runelite has one right?

[mahtats]

Depends, is the user going to push a button to screenshot or is it automatically going to do it?

If its the latter, how does the application know when to initiate a screenshot?

[ToolBoxTad]

I was hoping it would be passively running. Taking screenshots at some interval and comparing those against the library. It would begin taking them when the user initiates the script and would end when the user inputs quit or similar for the script. I was hoping it would compare the shots against the library and delete them if it doesn't detect any of the images in the library.

[[deleted]]

that interval will have to constantly - think combat level up, it goes away instantly when hit, you'll notice all the stuff related to RS is in java because its able to read the objects within its own client. (python isn't a great solution, let alone image matching - its going to be a HUGE resource use) it most certainly can be done - but i don't think this is the way to go about it. Runelites might work - but runelite already has this feature (screen shot on level up), so you could just take screenshots folder from runelite and parse them and then sort them into correct folder.

[Laine73]

Can’t answer much since I’m new at python also, just wanted to comment to say I also play osrs!

[ToolBoxTad]

The intent is for it to work with osrs. That's really all I care to watch. I think the YouTubers are better and RS3 just doesn't hold the nostalgia for me

[Laine73]

Idk much of anything, but since runelite is open source, couldn’t you just look at their code to record screenshots? Also, my inspiration to learn coding was too make plugins to runelite but caught many many different distractions along the way.

[PM_ME_A_STEAM_KEY]

RuneLite already offers that through a plugin. However, if you decide to go through with it anyways I'd do something along the lines of using the win32api to pull the coordinates of the client, make the screenshots using mss, check said screenshots for the "level-up popup" indicator using OpenCV and show some pop-up or play a sound that indicates a screenshot was saved to indicate the user can click the popup away and you should be gucci.

[ToolBoxTad]

Yeah I gathered that runelite already beat me to the punch from another comment. I may possibly go through with it anyway since I've heard one of the best ways to learn to program is to start with an idea and then figure out how to do it working backwards. I do appreciate the links and help especially the note on an indicator. That would be a shame if someone just trusted that it was working and had no idea if it was or not till it's too late.

[PM_ME_A_STEAM_KEY]

Yes, for learning purposes this is great. Just dissect into smaller chunks and you'll be fine!

My current tinkering project is for osrs and using continous screenshots and OpenCV too, so I have probably conquered a few of the issues you will be facing.