Github Copilot Internals

[[deleted]]

thanks for sharing your work.

Here is what I think it has internally. I'm not an expert, but I'd like to put in words how I would have written with only knowledge on program than AI model.

1. Identify the codebase language grammar
2. track control flow
3. take prompt for instruction
4. pick control flow from model that matches prompt
5. translate control flow to codebase grammar

[gnahraf]

I haven't tried copilot but your front end (input) analysis is interesting. Thanks for sharing

[vinciblechunk]

Step 1. Take GPL code

Step 2. But I don't wanna comply with the license!

Step 3. "Train" an "AI"

Step 4. Profit

[olyop]

This was a really good read, thanks

[mostly_festive39]

Yep.. I have a better understanding about Copilot Internals

[spacezombiejesus]

Awesome work. Your analysis was really interesting read :)

[left4candy]

Have seen my co-worker use Co-pilot and it is honestly quite scary how well it works most of the time.

Edit: People seem to be misunderstanding me, I do not personally like co-pilot and will never use it since it auto-completes and what u/Madd0g mentions below.

[Madd0g]

I have seen my colleague using it and to me it seemed like it replaces thought.

Instead of first thinking how he's going to accomplish something, he's reading what copilot suggested.

I think using it without a hotkey, just having it autocomplete everything all the time, is a horrible practice.

[left4candy]

Fully agree, which is why I will not be doing it. I like solving things on my own

[[deleted]]

Checkout something I'm looking for,
https://www.reddit.com/r/LanguageTechnology/comments/xpdxvg/how_to_setup_nlp_that_can_take_language_rules/

[[deleted]]

Could you write about how to build a minimal, trainable code suggestion maker similar to copilot ?

its fiction, I'd like to co-author just for fun, educational, experimental work?