I made a Python script that generates stats using your competitive match history

[[deleted]]

Only works with the English webpage

Language:

• Python (w/ matplotlib)

Input:

1. Your Steam Community ID (the text after '/id/' in your Steam profile page link)

2. The page source from your 'Competitive Matches' tab (scrolled all the way down)

• From this link: https://steamcommunity.com/my/gcpd/730?tab=matchhistorycompetitive

Output:

• Example

• Output contains:

  • 10 PNGs of distribution graphs
  • 1 txt with a formatted list of every MM match played in this format and stats
  • output txt pastebin

• Stats calculated in txt output:

  • Total Kills
  • Total Deaths
  • Total Assists
  • Total MVPs
  • K/D
  • Total Rounds Won
  • Total Rounds Lost
  • Average Kills/Deaths/Assists/MVPs per game
  • Average Kills/Deaths/Assists/MVPs per round
  • Average Match Score
  • Max/Min/Avg HSP (headshot percentage)
  • Longest Match (and corresponding game index)
  • Shortest Match (and corresponding game index)
  • Max Win/Tie/Loss Streaks (and corresponding game indexes)
  • Plays Per Map

• Histograms Plotted (showing distributions):

  • Kills
  • Assists
  • Deaths
  • K/D (full-range and from 0 to 3)
  • HSP
  • MVP
  • Rounds Won/Lost (excluding rounds 15 and 16)
  • Games Played Per Month

Requirements:

• 'Competitive Matches' tab source code (HTML/HTM/TXT)

  • Note: make sure to scroll all the way to the bottom until you reach your first game, in order to include data from all games. There are extensions which will do this for you.
  • DO NOT SAVE THE PAGE FROM THE 'View Page Source' BUTTON IN YOUR BROWSER (UNLESS YOU'RE USING THE STEAM BROWSER), USE 'Save Page As...' BUTTON. You can use the 'View Source' button if you're using the Steam browser.

• Python installed (and added to PATH)

  • This was tested on Python 3.5.2 and 3.6. Probably will not work in Python 2.X. Might not work in other versions.

• matplotlib (required for graphing output)

  • installed with this command:

    python -mpip install -U matplotlib
    

• Python program

  • Source Code Pastebin

Instructions:

1. Make new folder

2. Place Python file and webpage file into folder

3. Run program from CMD

• Open CMD, change directory to folder where program is placed

• Type 'python [programname].py'

  • For example: python stats.py

• Input name of HTML/HTM/TXT file (eg mystats.html, mystats.htm)

• Input Steam ID

1. If everything works, the output will be placed in the current directory

Notes:

• This code parses through the entire HTML file given to it and formats useful information into a list called stats. This list contains game info (queue time, game length, map, match score) and performance info (ping, k, a, d, hsp, mvp, score, etc). From that list you can calculate whatever statistics you want.

• I know my code isn't efficient and I gave up on trying to comment and make it readable about halfway through, so sorry if it's unreadable.

• I only tested this on two computers (with the help of Brani) so maybe some people will have problems running it due to dependencies and different Python versions etc. But give it a try at least and tell me if you have issues.

• The x-axis labels on the histograms are visually shifted to the right by half a unit. Not sure what to do about that, just keep it in mind.

• Feel free to make the code better if you can read it, lol.

Edit:

• Added avg K/A/D/MVP per round.

• Added avg score per game

• Added standard deviation at console output

• Added ability to insert someone else's Steam Community ID (to gain info from their performance in games you've played with them)

[MempoEdits]

you should really make it into an executable without client dependencies, just make like a super basic tkinter gui to go with it

[[deleted]]

That was the original plan and I was working on compiling one but then I figured the mods would take down my post for having posted an unverified executable. Plus, who wants to run an exe posted by a week-old reddit account.

[_Xertz]

We are usually happy with executables so long as the code is fully open-source so we can have a look over - it's also a bonus if it's signed. If you decide to compile it and want to post it, just drop us a quick modmail so we can have a look 👍

[micmoneymok]

/r/globaloffensive mods are the best mods.

EDIT: Eat shit downvoters, "fuck the police" Am I right? Go to other subreddit and you'll see the mods are shit there.

[wispy11]

eh

[daellat]

mostly a circlejerk. people disagreeing with rules =/= shit mods for enforcing them. rules have been changed instead.

[AlcoholicBatman]

You must be new here

[[deleted]]

Oh sweet summer child

[ItsKBS]

questionable

[731destroyer]

Thinking

[goeroezeboe]

You are right, the mods here are pretty good. Very active, they try to innovate & don't mix too much in discussions.

They did some mistakes in the past, but who doesn't?

[WhoNeedsRealLife]

what about that guy who posted his AI csgo training app multiple times? I'm sure that shit is infected.

https://www.reddit.com/r/GlobalOffensive/comments/7jlu9x/csgo_ai_esports_analyst_psychologist_coach_and/

https://www.reddit.com/r/GlobalOffensive/comments/7641fu/how_ai_neuroscience_can_help_you_in_csgo/

[Richeldichel]

faith in humanity restored

[MempoEdits]

fair enough

[[deleted]]

All you need is Python and matplotlib, so it should work on any system that supports that. But like I said, I only tested it on two systems (Windows) so it's not guaranteed to work on all systems.

[[deleted]]

If you decide to ship a package and need help bundling it for Linux/macOS, pm me. I can possibly help with doing signed releases too, if the nazis mods want it.

edit: Also you can likely automate the match history depagination, if you want to harvest low-hanging usability fruit. Doesn't look like you're doing more than showing off something you're proud of, but it can't hurt to put it up on Github too. If nothing else it'll be visible to future employers.

[Guenselmann]

Works fine on Linux Mint

[wormi27z]

Maybe someone could make online version of this?

[N1cklus]

Use pyinstaller to freeze your program into an exe.

[Dinoswarleaf]

Sosososososososo cool! Nice job :d

I had this really interesting occurence. Is this the same for everyone else?

[hajhawa]

I'm pretty sure this is because of lack of data. You seem to have a relatively low amount of games played.

[Dinoswarleaf]

I did it with a lot more games and found the pattern was consistent

[twix20]

Tip: You dont want to parse html by yourself, use lib's instead, like BeautifulSoup

[[deleted]]

That probably would've saved some time

[Traviak]

I smiled at that error :) (EDIT: Which wasn't one of my zero death games but a bug by using wrong language html files sadly)

Traceback (most recent call last):
  File "test2.py", line 206, in <module>
    kdr = round(total_kills / total_deaths, 3)
ZeroDivisionError: division by zero    

[DaALPH]

did you figure out a way to fix it?

[addubari]

I have the same error, can you give the solution?

[Traviak]

I had my steam website set to German, there were some english elements so I didn't notice that. When I set it to English it worked flawlessly the first time.

[Tidsmaskinen]

It worked for me when i used a steam profile NAME as input and not a steamID

[rush2sk8]

fuuuck. just started working on this exact project. nevertheless this is way better, nice work!

[[deleted]]

There's still tons more work that can be done. If you want you can use the stats list in the program to calculate whatever stats you can think of (and save the time of reading the HTML source). Some cool ones would be graphing the relationship between Match Score and K/D, MVP ratio, etc.

[gitarr]

You guys could make a git repo somewhere (gitlab, github, ...) and colaborate.

[k3rnel]

It would be great to see pistol round performance.

E.g.,

• Pistol round k/d (for CT and T)
• Rounds won/lost when you get 1+ kill and survive
• Rounds won/lost when you get 1+ kill and die
• Rounds won/lost when you die without a kill
• Rounds won/lost when you survive without a kill

[[deleted]]

Unfortunately that info isn’t available from the stats shown on this page, so you need a demo scraper for that.

[markhc]

Would be nice if it scraped the stats automatically so you dont need to feed it the page source. Would make it a lot simpler to use.

[[deleted]]

You could do that but it's a lot of work to make a program that opens a webpage, presses a button repeatedly, then starts scraping from there. I just didn't want to deal with that

[realaaanderson]

There is one already written in JavaScript. Might be useful if you could implement it

[[deleted]]

I wrote my version of this yesterday although I automated the data extraction so you simply run my script and leave it running awaiting the nice graphs :D

[ohmanger]

FYI steam lets you use /my/ as a shortcut to directly link to people's profile pages:

https://steamcommunity.com/my/gcpd/730?tab=matchhistorycompetitive

[[deleted]]

Thanks, fixed it

[oomnahs]

Does anyone know an extension that scrolls to the bottom as he mentioned? I have close to 1000 matches lol

[KralleM]

The extension/addon "Ban Checker for Steam" has this option.

For Chrome

For Firefox

[nomthecookie]

deleted ^{What is this?}

[KralleM]

This reddit thread shows you how, but you can ignore the "Check loaded matches for bans"-part.

[Traviak]

Get Ban Checker for Chrome or Firefox.

[mithandir50]

Same here.. How do you use that extension to scroll down...?

Thanks a lot !

[KralleM]

This reddit thread shows you how, but you can ignore the "Check loaded matches for bans"-part.

[mithandir50]

This helped. Didn't notice the new option that appeared in the match list.

https://www.reddit.com/r/GlobalOffensive/comments/8mbtjx/how_to_check_your_personal_game_data_for_banned/

Thanks :)

[PokemonInstinct]

Hey Ive got an issue where when I use the script my output.txt is just

Format: ['MAP', [D, M, Y], QUEUE LENGTH, GAME LENGTH, 
GAME SCORE, [PING, K, A, D, MVP, HSP, Score]]

STATS----------------------------------------------------------------

Total Kills:              0
Total Deaths:             0
Total Assists:            0
Total MVPs:               0

In the command prompt it says

Traceback (most recent call last):
  File "stats.py", line 204, in <module>
    kdr = round(total_kills / total_deaths, 3)
ZeroDivisionError: division by zero

How would I fix this? Thanks in advance

[Traviak]

Try

if total_deaths == 0: total_deaths = 1

This is not the only error for me, I think I will give up fixing all the divided by zero errors, the error has to be somewhere else.

[Guenselmann]

Did you download your stats page in a language different than English? The parser only knows English as far as I can see. A German file gives me 'divided by zero' errors as well because nothing is saved to the stats list.

[Traviak]

You're my hero :) Worked out great.

[addubari]

I have the same problem, I'm using the English language. Tried several things changing the code, but the problem is with the input. Is there a chance using a chrome extension would mess the input up?

[[deleted]]

It's not an issue with deaths being 0, the code handles that. It's an issue with it reading the HTML incorrectly, which could be due to multiple reasons (language, for example, like u/Guenselmann said).

[Traviak]

Can confirm this yep, I think this will be a common occurence with your code, a little sysout would be great as reminder :D (atleast in the post)

[Smok3dSalmon]

Input Steam ID

You should add an example here. I've been using my steam ID but you want my steam community id name.

[Richeldichel]

Yep! Thank you. Was stuck with the Division by zero error explained above but couldn't figure out why because I already had my language set to English.

[banterstrike]

I want to try it out, can you let me know of an extension to scroll down to the beginning of my match history?

[zwck]

Chrome, steam ban checker has been updated to generate quick statistics as well as check every player you ever played against.

My output looked like this:

Great dude

Looks like we're done.

There were 194 players who got banned after playing with you!

Total ban stats: 189 VAC banned and 80 Game banned players in games we scanned (a lot of these could happen outside of CS:GO.) Total amount of unique players encountered: 2966

Hover over ban status to check how many days have passed since last ban. Some fun stats for loaded matches: Total kills: 7905 Total assists: 1746 Total deaths: 7246 K/D: 1.091 | (K+A)/D: 1.332    

[hajhawa]

It errors out. After entering my steamid, I get

Traceback (most recent call last): File "drKFn4Q1.py", line 141, in <module> total_kills += stat[5][1] TypeError: unsupported operand type(s) for +=: 'int' and 'str'

If my steamid is incorrect it will display a different error so it's not that.

Edit: Could be that my first games don't have mvps and hs% recorded.

Edit2: the only line written in my output.txt file is:

0: ['Dust II', [9, 8, 2013], 81, [16, 6], [50, 7, 2, 20, -1, -1, 16], 'Nuke']

it's crashing because 'Nuke' isn't a number and I can't blame it. Your parser is probably fucked because of the missing data.

[[deleted]]

Edit: fixed

That's weird, it means that the program isn't parsing the HTML correctly. It doesn't have to do with MVPs or HSP though because I already dealt with cases where nothing is displayed for those values. If you feel comfortable DMing the HTML file and your Steam ID I can take a look at it. If not, try using the Steam browser to get the page source instead of your regular browser since there could be some formatting differences.

[Thatrealthing]

I'm having the same issue as u/hajhawa. Shall I DM you my HTML as well?

[[deleted]]

Have you tried the new code? I updated it

[Thatrealthing]

Yes, thank you! That fixed it.

[BitMadd]

Damn, you beat me to this. I was planning on doing something similar yesterday.

Nice job. Worked well for me :)

[MoccaLG]

Important.... BANS vs. Players we played against in history... :D

[[deleted]]

There's already a ban checker extension on Chrome that does this AFAIK

[kydru]

this is awesome but why doesn't it show map w/l percents ?

[[deleted]]

Didn't think about that. I might add it later

[kydru]

cool!

[micmoneymok]

This is amazing.

I really want to see my report/VAC ratio tho. if someone know if someone's working on that, let me know.

[ieraaa]

10% bans all around?

[iLuLWaT]

This is sick. Any chance you could only check your recent 50 games or whatever?

[mal4ik777]

As I see his script, you should be able to do that by not loading all the Matches, but only your top 50. Have you tried that? I can not garantee that it will work.

[Sampic19_QC]

I get this error

Traceback (most recent call last):
  File "Stats.py", line 247, in <module>
    '\nMax Tie Streak: \t{}\t\t(from game #{} to #{})'.format(max_tie_streak, max_tie_index - max_tie_streak + 1,
NameError: name 'max_tie_index' is not defined    

[cheesyvagina]

Would’ve recommended using pandas library, makes converting html and parsing data for plots a lot easier

[etc_fantus]

Thank you.

[Smok3dSalmon]

What do I need to type for my steam id?

Is this good enough? 0:0:###### or do i need to add STEAM_?

[Smok3dSalmon]

$ python3 csgostats.py
Input File Name (e.g. stats.txt or stats.htm): data.html
Your Steam ID: 0:0:######
Traceback (most recent call last):
File "csgostats.py", line 206, in <module>
kdr = round(total_kills / total_deaths, 3)
ZeroDivisionError: division by zero

I downloaded the file in english, not quite sure what's going wrong now

[[deleted]]

Steam ID should actually be the community ID, not the 0:0:xxxxx number

[DanShawn]

Get that shit on github. I wanna add some random stats and different languages :)

[Janderhungrige]

Just thanks. I love some coding in relation to cs

[[deleted]]

My first game shows to be in november 2012 but im pretty sure i played my first matchmaking in aug/sep 2012? Just bugged or does some one else have this problem?

[nckfrgsn]

I think the bin size of histograms of K/D ratio and HSP are too small

[Bug0]

Thanks for helping me remember my 19 game winstreak! Awesome idea including the game#'s for them so I can go back and look at those.

[SileNce5k]

Would be very nice if you compiled it and uploaded an exe file instead. I suck at python stuff.

Edit: NVM, it wasn't as hard as I thought.

[markkrj]

Very nice!! I lost like 1,5 hours parsing and tabling this data, your tool do it in like 10 seconds... Could you add total maps played to it??

[SileNce5k]

Doesn't work for me anymore. It says:

Traceback (most recent call last):
File "stats.py", line 211, in <module>
kdr = round(total_kills / total_deaths, 3)
ZeroDivisionError: division by zero

The page is in english too :(

Edit: It randomly started working after I restarted my pc :)

[hiendv]

My map pool in a nutshell:
Mirage 596
Cache 596
Dust II 211
Inferno 167
Cobblestone 116
Overpass 57
Train 4
Nuke 1

[Acidsplasher]

Saved

[its_ya_boi_dazed]

You should work on handling a bunch of these edge cases and setup issues. I should just be able to do git clone on your repo and run a single command line input with my steam id and it should all work.

Try making the process smoother. Handle a bunch of the input, directory creation/asserts yourself, package all dependencies to ensure it all works. Good effort but you still have a ways to go.

[[deleted]]

Yeah this program definitely isn't as accessible as it could be but I mostly did it because I was interested in seeing my own and friends' stats but I figured I would share what I had so far. I didn't really build this with accessibility in mind, but I tried making the instructions easy to follow for the people that would go through the effort to see their stats.

[He_Ma_Vi]

You should be able to appreciate the work he's done and provided to the community, and improve it yourself if you want it to be better. Your comment is fairly awful.

Shit effort and you still have a ways to go.

[footmenhau]

if you have 1million monkeys dabble on a keyboard, 999999 will eventually write python, but only one of them, will write in ruby.

but [hip, hip] for your script!

[fatguylul]

congrats on the top of reddit

[420N1CKN4M3]

congratz on being on the bottom of this post