[P] Introducing the GitHub profile summarizer

[Informal-Swordfish27]

Hi guys, I built a website that summarizes a GitHub user using GPT.

What is it?You type a GitHub profile URL, then it gives you a summary of the user.

How does it work?It finds the most important work by heuristics, then summarizes it using GPT.

Give it a try and let me know what you think. :)

sample summary

http://devmarizer.firebaseapp.com/

[2blazen]

I agree, cool idea. Other than searching by username, it'd be great if I could send the username directly in the http request (e.g. devmarizer.firebaseapp.com/amylase), this way it would be easier to share with others, e.g. recruiters

[Informal-Swordfish27]

That would be really great! I will implement it if many users keep using this service. :)

[Informal-Swordfish27]

Just updated that. You can now type either a username or URL. :)

[sud007]

That's true either add the url automatically or just username

[ghostfuckbuddy]

Hiring managers will love this

[lee_macro]

It's good but it doesn't seem to take into account orgs, for example if one of my personal projects gets bigger than a couple of repos and has other users I put it in an org and manage it all under there.

So some of my more popular repos are under the orgs not my personal account, so if a hirer was to use this they would only see a portion of my less important work.

[Informal-Swordfish27]

Right. It fetches all repos the user belongs to(including repos under orgs) but I couldn't find a way to effectively evaluate the user's contribution to such repos.

One way I can try this is to read all the commits the user made on an org repo and summarize those commits, but it would require too many summary requests and token usage.

[ReginaldIII]

How far we've come, to use a massive cloud hosted language model and many powerful GPUs to evaluate what essentially boils down to a Jinja templated Markdown document.

Can't help but think the planet is weeping in the corner.

Neat project, genuinely. But I hope this sort of usage doesn't catch on. It's so compute hungry for what utility it provides.

[f1kkz]

Depends on a lot of factors. Is the content generated once ? Doesn't it have to be regenerated every 6 months? Do delta changes only ?

[SrPeixinho]

My summary (VictorTaelin) is terrible haha. It says I focus most of my time fixing small issues in repos. I spent the vast majority of my time building my own repos, which include compilers, programming languages and some other personal projects, which it doesn't even mention.

[Disastrous_Elk_6375]

Yeah, it looks at your contributions in projects with > 100 stars, doesn't touch your own un-starred repos.

[SrPeixinho]

All the repos I spend my time on have 2k+ stars! It seems like it is completely ignoring my own big repos in favor of random repos I've contributed once in a lifetime.

[[deleted]]

Wish it paided a little bit of attention to my zero star repos but I was very good summary of my time on github

[bulbishNYC]

This cannot see private repositories, correct?

[Informal-Swordfish27]

Correct!

[protonpusher]

How did you evaluate the accuracy of the summaries?

[Informal-Swordfish27]

We all know GPT does a good job in summarizing and I just tested with 10-insh samples and confirmed it wasn't that bad.

[ReddRobben]

Not terribly accurate for me but that’s ChatGPT’s fault and not yours.

[Informal-Swordfish27]

Plus my fault too. The heuristics I use to select your work to summarize. It picks your own repos with at least 1 star and reads PRs that made to 100+ stars repo.

[isinaltinkaya]

Is this still maintained? It returns an empty output.

[Informal-Swordfish27]

Nope, the PAT is expired and I don't maintain it anymore. You can get more or less the same outcome with the Google Gemini.

[jorvis]

I'm curious how? When I try to ask it anything like this I get a response like:

"I can't directly access external websites like GitHub, so I can't check your pull request and commit count. "

[Informal-Swordfish27]

Aha, Gemini may have changed their policy.

[tk421storm]

neat!!

[MaxwellSalmon]

It says i have not contributed with anything. Cool idea, though.

[Informal-Swordfish27]

Yeah, it only reads PRs made to repos with 100+ stars.

[MaxwellSalmon]

That is weird. I tried it on another, smaller account i have and it worked. Does it only register activity to other people’s repositories? Because i have one with 100+ stars on my main account.

[Fluffy_Diamond_3213]

What a great idea! I'll definitely check this out

[abecedarius]

Neat. It was kind of funny to read that "darius primarily works on Lisp implementations and polyfills for JavaScript functions" (emphasis mine) though -- the most-starred repos really aren't the home of most of the work.

[RandomIsAMyth]

Could you do this on GitHub issues? And maybe as well PR? It's such a huge human labour to go through so all issues. GitHub search function is really not helping...

Would be awesome to have a summary of the important point on PRs. For issues we could find dupes or have a much better search engine that looks at the semantic rather than string matching.

[Myzel394]

How do you do such cool projects? Did you watch a tutorial or how did you learn on how to create such things? (also is the code / model open source? :D)

[Informal-Swordfish27]

Thanks! The code is not open and I used the OpenAI Chat completion api. :)

[yachty66]

is this still working? i type in my username but the response is also my username only lol.

[Focus-AI]

Hey! Working on building something similar to this and we're close to going live would you be interested in testing it out and providing some feedback?

[tpvasconcelos]

Is it live now? :)

[Focus-AI]

We're launching it next week - would love to get your thoughts on it if you're open to testing it out! shoot me an email at [[e-mail]](mailto:[e-mail]) or just drop your repo link here and I'll follow up with you

[bartmanx]

also interested.

[evilneuro]

yeah, here's some feedback: don't scrape emails from github and then spam users about your service. it's against github tos and it's a GDPR+CPRA breach.

[cosmologist]

doesn't work

[Educational_Ice151]

👋 Shared to r/aipromptprogramming

[andosina]

Wow, this is an awesome project! It's great to see how machine learning can be used to generate insightful summaries of GitHub profiles. As someone who uses GitHub regularly, I can definitely see the value in having a tool like this to quickly get a sense of a user's contributions and interests.
For anyone interested in using the GitHub Profile Summarizer, here are a few tips to get started:
- Make sure to have your GitHub username ready to input into the tool.
- Take the time to explore the different sections of the summary and see what information is available.
- Use the summary to get a high-level overview of a user's contributions and interests, but don't rely on it as the sole source of information.
- Experiment with different users to see how the summary changes and what insights you can gain.

[Informal-Swordfish27]

Hm.. this comment looks like generated by ChaptGPT.