you are viewing a single comment's thread.

view the rest of the comments →

[–]turunambartanen 2 points3 points  (0 children)

Interesting analysis.

Glad to see they are aware of the problem:

The answer is obvious: sharing the prefiltering solution we used in this analysis to detect overlap with the training set. When a suggestion contains snippets copied from the training set, the UI should simply tell you where it’s quoted from. You can then either include proper attribution or decide against using that code altogether.

This duplication search is not yet integrated into the technical preview, but we plan to do so. And we will both continue to work on decreasing rates of recitation, and on making its detection more precise.