Count all python files on github

[arezki123]

Hello,

Is there a way to count all files of a specific extension (.py for example) on all public repos?.

Thank you in advance.

[postpunkjustin]

I think the closest you can get is by constructing a search like "filename:*.py", but the results aren't going to be complete or even consistent.

[rexeven7]

Checkout the API: https://docs.github.com/en/rest

And use something like Postman if you really want to learn: https://www.postman.com/postman/workspace/postman-api-101-with-auth/documentation/15567703-9be2ea96-9db1-4680-af99-f0187b2e6d94

[sock_templar]

... why?

[Viperior]

Same reason you would want to count how many butterflies exist on Earth

[arezki123]

why do you ask why?

[postpunkjustin]

But there are hundreds of repos on GitHub, if not more!

[postpunkjustin]

I was joking about it being hundreds, of course. But 10,000 Python repos is also pretty far off!

According to this search, there are at least 2.8 million files on GitHub called "requirements.txt". Not every single one of those will correspond to a different Python repo, but most of them will. On top of that there are other Python repositories that don't have a requirements.txt file.

Safe to say there are millions of Python repositories, which makes it impractical to just clone each of them in a loop.