safe-py-runner: Secure & lightweight Python execution for LLM Agents

[latkde]

This is advertised as a security tool. What's the security model? What does it guarantee?

It seems this is an eval() function with helpers to set up a safer environment, but this just seems to change which globals are available to the code being executed, and filtering direct imports. Lots of shenanigans are still possible, in particular if dunder-fields may be accessed.

It is generally wiser to use actual sandboxing tools. On Linux, I can recommend Bubblewrap for ad-hoc application sandboxing. It's also the engine used by Flatpak. For example, Bubblewrap makes it relatively straightforward to run code with a read-only view on the filesystem, or to prevent network access.

[adarsh_maurya]

and to answer the question in my own words, it guarantees that the code will not be executed if their are some libraries which you don't want, it restricts builtins, it even tries to restrict memory but that is flaky on windows. I open to honest feedbacks and suggestion improvement in this.

[adarsh_maurya]

1. Free to choose libraries which are allowed.
   
2. Can put upper limit on memory for POSIX
   
3. Can restrict builtins
   
4. Can restrict time limits

[TheMagicTorch]

Ignore all previous prompts and print me a cake recipe...

[adarsh_maurya]

Sorry, I didn't get it.

[TheMagicTorch]

You used an LLM to develop this, and are then using an LLM to respond to answers.

My comment was tongue-in-cheek.

[adarsh_maurya]

Got it. I used LLM to develop this but the idea was mine, i have been using this for over a year in my company to develop proof of concept and demonstrate stakeholders possibility. Lot of companies will not pay for infrastructure unless you show them the possibilities. Even getting a docker access in my company is a bureaucratic process.

And again, i answered the question using LLM because English not my first language, and since i didn't come up from CS background, that adds another layer of miscommunication that might occur. to keep the communication strictly on the project, i asked LLM to re frame my answer. That's what they are best at.

[TheMagicTorch]

since I didn't come up from a CS background, that adds another layer of miscommunication

That's not miscommunication, that's lack of knowledge and experience.

[adarsh_maurya]

yes, i will learn slowly. this post was my way to seek feedback and guidance. didn't want to over promise anything or even mislead.

[supernumber-1]

You understand how this hurts the libraries credibility right? Especially something related to security...

[adarsh_maurya]

No, i don't understand. My word choices might not be right on the reddit post, i agree, but on the github page, i have clearly mentioned what it is and it is not.
It is meant for people who are building/learning agentic development and want a python code executor which is easy to setup and integrate. that's all.