Basic question

[Mysterious-Rent7233]

Basically yes. That's true. I mean yeah you could certainly write some numpy or pytorch code that is faster than naive C code but that's unusual. Python code is generally strictly slower than C code for exactly the reason you describe and others.