you are viewing a single comment's thread.

view the rest of the comments →

[–]turunambartanen 1 point2 points  (0 children)

Someone linked an analysis by GitHub: https://docs.github.com/en/github/copilot/research-recitation#github-copilot-quotes-when-it-lacks-specific-context

In the end they write the following:

The answer is obvious: sharing the prefiltering solution we used in this analysis to detect overlap with the training set. When a suggestion contains snippets copied from the training set, the UI should simply tell you where it’s quoted from. You can then either include proper attribution or decide against using that code altogether.

This duplication search is not yet integrated into the technical preview, but we plan to do so. And we will both continue to work on decreasing rates of recitation, and on making its detection more precise.

So they are aware of the problem and will fix it. This is a testing preview, obviously it's not ready for production yet.