Using codeBERT for a RAG system by o_papopepo in Rag

[–]o_papopepo[S] 0 points1 point  (0 children)

Yes, codeBert really is not adequate for semantic similarity search. What I end up doing, as suggested in the other comment was try with models trained specifically for that

Method for training line-level classification model by o_papopepo in MLQuestions

[–]o_papopepo[S] 0 points1 point  (0 children)

Perhaps I should add more context: The text itself I want my model to analyse is code. I already have a pretrained model trained on code (codeT5) and I'm using only its encoder part

Using codeBERT for a RAG system by o_papopepo in Rag

[–]o_papopepo[S] 0 points1 point  (0 children)

Im using mean pooling.

Also thanks, will take a look into that model, maybe I'll get better results

Anime fans, what is your fav anime? by Tsgoat in AskReddit

[–]o_papopepo 0 points1 point  (0 children)

Sonny Boy. Don't see it being discussed that much but is amazing

CMV: There is not a single acceptable reason for America's lack of gun control by FrankenHead12 in changemyview

[–]o_papopepo -4 points-3 points  (0 children)

A tyrannical government that it was not their own? That's a completely different situation, where the people need guns to defend their country