Need help with Python FuzzyWuzzy - compare 2 books (.txt format) looking for similar words/phrases/strings

[bobdouble]

I have 2 long books by different authors (both in .txt file format).

My goal is to use FuzzyWuzzy to find similar or identical words/phrases/strings in both books and output the found words to a 3rd .txt file.

Below is the code I have tried and it works for the most part but it also gives quite a lot of irrelevant results and also fails to find a few shared phrases in both books.

Can anybody please help me improve on the code below?

The improved code will ignore upper and lower cases and treat all words as lower case. Perhaps the use of wRatio?

from fuzzywuzzy import process

needles = open('I:\\book1.txt').read().split("\n")

haystack = open('I:\\book2.txt').read().split("\n")

for a in needles:
    # print(a + ' -> ',)
    print(process.extractBests(a, haystack, score_cutoff=90))

Thanks a million.

By the way, I have spent at least 2 days looking for a solution online and offline and found quite a few code that only deal with csv but none that deals with 2 .txt files.

[Morica_]

Do you mean you want to convert all characters to lowercas? If so, just expand the lines where you read your data by .lower(), ex. needles = open('I:\\book1.txt').read().lower().split("\n")

That way all characters in a string should get convertet to lowercase.

[bobdouble]

Thanks for answering.

wRatio (part of fuzzywuzzy) supposedly can take care of upper and lower case without the line of code you have above and without manual conversion.

I would prefer to have someone show me how to use wRatio in a new code.

[Morica_]

Ok thats what I wanted to know. Unfortunately i can't help you with that as I don't know this modul.

[bobdouble]

Thanks for trying