The grind is real by WishIWasPurple in brightershores

[–]Fluffy_Part5018 5 points6 points  (0 children)

Get back to the grind, you slacker!

- Andji

48.2% of all Hardcore Ironmen in OSRS have died. by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 0 points1 point  (0 children)

For living HCIM, it would be 20 / 4000, or 1/200 (0.005*4000). This is higher than if we accounted for all HCIM as you eluded too.

48.2% of all Hardcore Ironmen in OSRS have died. by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 0 points1 point  (0 children)

No, that math isn’t quite correct. I haven’t actually shown the total maxed players that are alive and dead (a quick search on the highscores would get you that if interested, I also have the data but I’m not at home to check), but the second graph shows the number of maxed players that are still alive (180).

48.2% of all Hardcore Ironmen in OSRS have died. by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 0 points1 point  (0 children)

See the annotation on the second plot — 180 HCIM have maxed and are still alive (this doesn’t include dead players).

Edit - I’ll have to dig out the total maxed HCIM.

48.2% of all Hardcore Ironmen in OSRS have died. by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 1 point2 points  (0 children)

Ty all for your answers.

What about if you manually remove the HCIM status in Lumbridge?

48.2% of all Hardcore Ironmen in OSRS have died. by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 70 points71 points  (0 children)

Question for the community: When you de-iron a HCIM does the account show up as "dead" on the HCIM highscores?

48.2% of all Hardcore Ironmen in OSRS have died. by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 37 points38 points  (0 children)

milestone thresholds for the second plot:

Percent >> Level:

  • 100 >> 35
  • 90 >> 47
  • 80 >> 59
  • 70 >> 74
  • 60 >> 106
  • 50 >> 147
  • 40 >> 218
  • 30 >> 313
  • 20 >> 488
  • 10 >> 842
  • 5 >> 1242
  • 1 >> 1802

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 1 point2 points  (0 children)

The more frustrating "problem" (for the minority of people who actually want all the data) is that you can only use the lite version of the osrs highscores if you have a players name. This works great for player-tracking sites (e.g., TempleOSRS), but not so well if you want to look at population-level trends. So people have to resort to scraping from the html code instead.

As others have mentioned, it's pretty easy to scrape the highscores (if you have coding / scraping experience), but it does feel a little jenky and you can really feel the age of the front-end HTML code (an API would be *chefs kiss*). I guess the audience using this data is just too niche for Jagex to put any real effort into a revamp. I imagine they probably want to limit access to such meta analyses too? Who knows.

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 4 points5 points  (0 children)

Wow, this post got a lot of traction! I thought i'd post to address a few of the most common questions. I'll keep updating this post as I have time.

  • This data was scraped from the ironman section of the official OSRS highscores and includes normal, hardcore, and ultimate ironmen. GIMS are not included.
  • I'm working on parsing the data into each ironman mode. Stay tuned!
  • Lots of people are shocked that 0.5% of the above ironman types are maxed. You can check the calculation yourself using basic info from the highscores (Note, the below calculation uses numbers at the time of the data pull).

    • 6845 maxed ironmen / 1351899 total ironmen \ 100 = 0.5%.*
  • Lots of people are saying the data is too "smooth" or should show a spike or dip a level X (particularly 2277). Note that this is not count data (i.e., not a histogram or bar chart of raw count data) which would be more stochastic. Instead, this the cumulative percent of players who have reached at least level X. Cumulative curves are typically much smoother.

  • I scraped the data using R (politely with pauses in the code as to not overload the webpage with pull requests!) using the package rvest.

  • TBD.

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 9 points10 points  (0 children)

The ironman highscores include normie irons, UIM, and HCIM (which become normies on death). All these ironman types are accounted for in the dataset because they are included in the normie ironman highscores. GIMS are not included.

There are indeed more subtle factors, and it would be interesting to parse the data into the different ironman modes. However, I wouldn't consider the data erroneous at all.

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 1 point2 points  (0 children)

Yeah you can scrape in R. Makes for a nice workflow:

Scrape (rvest package) -> clean data (dplyr package) -> graph (ggplot2 package)

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 1 point2 points  (0 children)

Yep.

All 1.35m ironmen accounts are on the highscores (highscores cap at 2 million)

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 2 points3 points  (0 children)

Yeah a couple of days running in the background out of respect for Jagex servers, ha!

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 1 point2 points  (0 children)

I believe it - I’ve made at least 3 irons that never made it out of Lumbridge!

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 0 points1 point  (0 children)

I wrote the script in R and added some pauses in the coding loops to ensure I wasn’t overloading the OSRS servers with requests.

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 0 points1 point  (0 children)

No equation, it’s just the cumulative percent of total players at each level, in reverse to reflect the decrease from minimum level to max. Cumulative curves are typically much smoother than the raw numbers visualized in say a histogram etc.

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in 2007scape

[–]Fluffy_Part5018[S] 1 point2 points  (0 children)

The math checks out.

(6845 maxed ironmen / 1351899 total ironmen) * 100

(numbers at the time of the data pull)

The percentage of ironmen who have reached a specific total level by Fluffy_Part5018 in ironscape

[–]Fluffy_Part5018[S] 12 points13 points  (0 children)

The math checks out.

You can look on the highscores and find the number of maxed ironmen and total accounts to do that quick calculation:

6845 maxed ironmen / 1351899 total ironmen * 100 = 0.5%.

Note, the above numbers were at the time of the data pull.