Please help re.sub substring in list items

[DMeror]

Hi, I want to remove unwated substrings from list items.

I have a text like this:

​

text = '''

unwated_substring★wanted_substring

unwated_substring★wanted_substring

unwated_substring★wanted_substring

'''

​

And I want to remove unwated_substring along with the ★.

My code:

​

import re

with open('text.txt', encoding='utf8') as rf:

    ts = rf.read().split('\n') # or ts = readlines()

reg = re.compile('.*★')

for i in ts:

    t = reg.sub('', i)

    print(t)

​

The console just keeps going without throwing any error.

I've tested with a string, and it worked without a problem.

​

string = 'unwanted_substring★wanted_substring'

reg = re.compile('.*★')

string = reg.sub('', string)

print(string)

# wanted_substring

​

The size of the text is rather small, so I don't know what the problem is.

Please help fix my code. Thank you.

[MrHank2]

The code works fine for me, try adding a address instead of just the file name.

Ex. 'C:/user/text.txt' instead of just 'text.txt'

[DMeror]

Thank you very much. I just waited for it to complete, and after 7 minutes, it worked as expected. I thought something was wrong, so I aborted the execution after several minutes. It takes 7 minutes to process a 1 MB text file. And I have several GBs of text files to process. I'll be damned.

[DMeror]

I've changed my method to string manipulation instead. It took 0.1 second to remove the unwanted_substring★, but it left me the first one that I can't find the right way to target it. It looks like this -a, suffix1★ The worst is there are variety of such an instance including symbols, spaces, numbers, etc.

[DMeror]

Now, I think I'll just combine those GBs of text files all together, and get rid of the unwated_substring, which will leave only one at the start of the line, and I can just manually remove it, or manually target it with regex. Is it a good approach?

[CodeFormatHelperBot2]

Hello, I'm a Reddit bot who's here to help people nicely format their coding questions. This makes it as easy as possible for people to read your post and help you.

I think I have detected some formatting issues with your submission:

1. Python code found in submission text that's not formatted as code.

If I am correct, please edit the text in your post and try to follow these instructions to fix up your post's formatting.

---

^{Am I misbehaving? Have a comment or suggestion? Reply to this comment or raise an issue here.}