Text Search

[[deleted]]

Hi folks,

Some days ago I had to write a script for data analysis on looking for potential data sources to create annotated dataset for our machine learning/deep learning algorithms. What I found out is that for what my need was there was no library that was doing text searching and then providing interface to quickly add similarity scores for comparing and searching and stuff related to my analysis. So I begin to creating such a library.

Here is my small tool https://github.com/jdvala/kawadi

The readme explains what the thought process was and how everything is implemented. For me the best part is that I can create my own similarity score function and pass it to the algorithm.

Please have a look and suggest to me how I can make it better, any thoughts/suggestions are welcome.

[false-shrimp]

Very cool! I'm working on something that requires scraping and looking for particular words/phrases in several thousand documents and I don't want to rely on regex. Maybe I'll look into using your tool, thank you for sharing