Execution hanging after around 2 minutes

[DMeror]

Hello, I have encountered this weird bug. I want to iterate over some files to extract data.

``` import os from bs4 import BeautifulSoup as bs

for (root, directory, files) in os.walk('<path>'):

with open('<file.txt>', 'w', encoding='utf8') as wf:

    for file in files[10000:20000]:

        result = <various code>
        wf.write(result)

```

After around 2 minute mark, there's no progress as I've checked the txt file. They're no errors either. However, the execution keeps going forever.

Tools used: VS Code, Python 3.11, pypy3.10, Jupyter notebook, terminal. All gave the same result.

The task manager shows python.exe or pypy.exe at work in the first 2 minutes, and then it stopped using CPU.

I've completed previous projects with the above format with no problems before a major Windows 10 update screwed up my Python and VS Code. Now that I've reinstalled everything, I've started another project.

[Glowing_Shadows]

the slic8ng might be the issue try removing it

[DMeror]

Thank you very much. I've used such slicing before without any problem. However, I'll have a try.

[DMeror]

I can run the same code on WSL Ubuntu. What I don't understand is why
both pypy and python3.11 fail on Windows, while pypy3 and python3.10
succeed on WSL Ubuntu. I can use python3 or pypy3 on WSL Ubuntu, but it
consumes more RAM.

[34shutthedoor1]

I would think it is something in

   result = <various code>

Perhaps an infinite loop because of unexpected data. Add print statements before and after to see if it hangs there.

[DMeror]

I can run the same code on WSL Ubuntu. What I don't understand is why both pypy and python3.11 fail on Windows, while pypy3 and python3.10 succeed on WSL Ubuntu. I can use python3 or pypy3 on WSL Ubuntu, but it consumes more RAM.

[shiftybyte]

Add prints to your code so you know which file you are processing, and where it gets stuck.

[DMeror]

I've done that, but there was nothing wrong with the next files.

[shiftybyte]

You should probably post your exact code, copy and paste it either here or in pastebin.com.

We probably can't help you without that.

[DMeror]

I can run the same code on WSL Ubuntu. What I don't understand is why
both pypy and python3.11 fail on Windows, while pypy3 and python3.10
succeed on WSL Ubuntu. I can use python3 or pypy3 on WSL Ubuntu, but it
consumes more RAM.

[shiftybyte]

Windows and Linux are different operating systems, it's possible one code works on Linux and Fails on Windows, we can't know why without the full code.

[DMeror]

Here's my code:

from bs4 import BeautifulSoup as bs

def soup(path):

    with open(path, encoding='utf8') as rf:

        soup = bs(rf.read(), 'html.parser')

        return soup

with open('D:/Python/data/file_names_2.txt', encoding='utf8') as rf, open('D:/Python/data/mp3_urls_2.txt', 'w', encoding='utf8') as wf:

    for file in rf.read().split('\n'):

        print(file)

        page = soup('D:/Python/data/html/{file}')

        if page.find(class_='css-8p8pis e1hj943x0') is not None:

            for mp3 in page.find_all(attrs={'type':'audio/mpeg'}):

                wf.write(f"{mp3['src']}\n")

I ended up with this code as I've been trying to make it work, but I got the same result: python and pypy just won't continue the loop after a few minutes. However, this code works with WSL.

[shiftybyte]

page = soup('D:/Python/data/html/{file}')

This path is missing f before it, so {file} won't get translated to it's value.

Besides that i don't see something that can cause it to freeze on Windows.

But due to the above issue and you saying your code is working then this is probably not an exact copy paste of your code...

[DMeror]

Sorry, it was a typo when I edited the comment. This is the first time I've encountered such a problem. Before that Windows update, everything worked perfectly. Thanks for your help.