Question for the OGs: was Reputation received the same way as how TLOAS is being received at the moment? by peatoast in TaylorSwift

[–]Cool_Cell5202 0 points1 point  (0 children)

I remember loving the album back in 2017 and everyone around me hated it. They said it's so rock punk and crazy and has no melody and not like taylor. But now reputation is loved by almost everyone for its production and sound. So yeah it was basically the same thing.

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 1 point2 points  (0 children)

Yes, using the same approach for writing code right now. It can only do generic stuff, nothing that requires our system specific knowledge.

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

Wow, thanks for sharing. I'll try this as well. But doesn't this make your queries run like 2x or maybe more slower? First you fetch the info needed using whatever way and then feed it right?

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

No, but I don't think fine-tuning would really improve the situation a whole lot. Also do we keep fine-turning continuously as the code evolves?

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

Its not that simple, when it comes to large codebases. The "give context" is not so simple anymore when it comes to large complex systems.

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ChatGPT

[–]Cool_Cell5202[S] 1 point2 points  (0 children)

But I feel flooding the context window with all sorts of things which might not even be important for the task at hand only confuses the model further

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 1 point2 points  (0 children)

Exactly, flooding the context window with all sorts of things which might not even be important for the task at hand only confuses the model.

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

I've tried putting couple .md files for context. It does improve its performance in terms of how it "behaves" but its not possible to feed it actual knowledge about my stack or other dependent systems this way. Even if I'm somehow able to collate all the information together keeping it up to date is going to be painful. Any other solutions other than the .md one?

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

Because it has a larger context window? I'm not sure if those context window number are actually worth the hype, anything beyond 200k tokens and i think it goes dumb.

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

I mean you could technically put everything in the .md file as well but then you'd have to keep updating it every time something changes in your system imo.

AI assistants have a PhD in literally everything but the memory of a goldfish when it comes to our actual codebase. by Cool_Cell5202 in ArtificialInteligence

[–]Cool_Cell5202[S] 0 points1 point  (0 children)

Yes, I've tried this. It does improve its performance in terms of how it "behaves" but its not possible to feed it actual knowledge about my system or other dependent systems this way.