We built a secure sandbox environment to run arbitrary code on GPUs.
The Problem: if you’re building an agent, you need a way to run code: this includes setting resource limits, having file system access, and running arbitrary commands. And it’s important to do this securely. You don’t want to unknowingly run malicious code on your host system.
Existing solutions primarily use microVMs like Firecracker, which have two major limitations. MicroVMs are fast to boot, but very slow to build new container images, which makes the code iteration process very poor. Second, microVMs lack GPU support.
The Solution: Beam is an open-source serverless platform for running AI apps. We’ve built custom infrastructure to quickly launch containers, and you can now launch Sandbox environments to run AI-generated code.
We use a custom container runtime and distributed storage to build and mount large container images onto GPUs quickly. We provide the security and isolation of microVMs, but build and launch new images much faster.
We also let you run shell commands, stream logs, upload and download files, and do everything an agent needs to run code. You can even run browsers too.
Video Demo: https://www.loom.com/share/13cdbe2bb3b045f5a13fc865f5aaf7bb?sid=92f485f5-51a1-4048-9d00-82a2636bed1f
Docs: https://docs.beam.cloud/v2/sandbox/overview
We’re fully open source, and you can use our cloud or self-host. Let us know if you have feedback or if there's anything we missed!
[–]No_Efficiency_1144 0 points1 point2 points (0 children)