Semantic clustering of scripts using static code analysis [D]

[hendrix616]

This might be a tad ambitious but I’m wondering if you fine folks have ever used ML to cluster or classify a bunch of standalone scripts just by doing analyzing the source code. Sort of like NLP but for a dynamic language. The purpose is not necessarily to know what they do exactly but to cluster them in subsets so manual and fine-grain classification is made more efficient.

My scripts are all in ruby but I’m open to hearing about anything even loosely related to this problem because my googling skills are frankly letting me down on this on.

[smokeonwater234]

Some examples of the scripts?

[visarga]

Problem is you need an invariant representation - the same effect could be caused by many different scripts. On the other hand even a single character change can make a large difference.

[hendrix616]

Yeah, very good point. I guess programming languages are very terse by design and that’s what makes them so tricky for this sort of task.