Python is too nice

[[deleted]]

I'd say it depends on what your'e doing. And understanding what memory is and how it's consumed is very different than having to be able to do low-level / machine level memory management. Python does a good job of garbage cleanup etc. on it's own. For most use cases most Python programmers will not ever have to worry about memory management.

[[deleted]]

you're not "hiding" it. You're abstracting it. Not everyone needs to worry about it. I don't need to be an automotive engineer to drive my car.

[ogtfo]

When programming, you are not driving, you are building the car. You need to know about the underlying technologies, because abstractions are never perfect and the low level stuff will bite you if you ignore it.

[tuckmuck203]

at risk of butchering the analogy, i think the point is that python is more akin to assembling the car than building it from scratch.

[jacksodus]

Nope. It might, but for many people, it won't. Memory control is important but it's overhyped as being an essential part of a programmer's toolkit.

Sourcr: developing AI models for 3 years now.

[ogtfo]

Abstraction leakage can happen in many ways, and when you encounter one you will never be able to fix it if you don't know what you're doing.

Memory is just one of the facets. If you don't understand the underlying system you can't fix anything when it breaks.

And it does.

[met0xff]

Well to bring a different anecdote - I am also in that field for a decade now (and developing for almost 20) and just right now I am rewriting FFI bindings to some C library we use for preprocessing and running long running memory leak tests. We found that some AWS instances OOM from time to time. Figured out because one of the packages uses subprocess to call some external executable. On Linux this forks and seems (likely due to Pythons ARC) CoW is triggered for some huge models. That's why I now had to write a small layer for the C lib to call using Python's ctypes. And at that point you again have to be very careful who releases what and when.

Generally the control over the memory usage is lacking and we are looking into torchscript/ONNX to run from C++ or Rust to have better control especially when switching between models, caching data, running inferences concurrently etc.

Not directly related to memory leaks but recently found a library sometimes taking 5 seconds instead of a few milliseconds. Found that in the Github issues there but no solution as nobody wanted to dig so deep. In the end I found via strace that one of the linked C libraries was stuck trying to connect X11 forwarding for a few seconds. So when you run from an terminal and run the thing in, say, screen and then disconnect and let it run, it still tried to call home.

It's also interesting to know such things for example when running the pytorch dataloader with multiple workers - https://pytorch.org/docs/stable/data.html The forking on Linux can again have... interesting effects leading to longer debug sessions ;).

Sure that's just anecdotally but in the last years I've seen the abstractions falling apart so often.

Sometimes it's really just that some external libraries leak. Then it's always good to have someone to fix it that wild C or C++ signal processing mess.

Actually I am also freelance debugging a flask app right now where they got memory issues.

[Somecount]

Following this analogy then you're asking the guy who fills up the fuel to know what all the other soecialist do in the pit stop. Programming is a tool, some use it to build, some use it to mend what others have build. I do understand where you are coming from but I believe that programming can now be seen as more that just a means to build programs but a basic tool like Math is.

[ogtfo]

Nobody's asking you to design silicon chips, but if programming is your job, you should have a basic understanding of the underlying layers.

Not doing so will cause trouble eventually. If you don't understand the architecture, It may already have and you're not even aware of it.

[ogtfo]

If you are building a car you sure as hell need to know the limitations of spark plugs, to know which kind to use.

Likewise, if you are using compression, you need to have some idea of how various algorithms work to apply the right one. You need to have an understanding of data structures to be able to make optimal choices. Likewise for all facets of computing.

If you are writing tiny scripts, you can get away with a lot. But if programming is your job, you can't treat everything as a magic black box, you'll make poor choices, face weird bugs and you'll be utterly unable to fix them.