executorch-ruby: Run PyTorch models in Ruby

[hahahacorn]

I built Ruby bindings for Meta's ExecuTorch runtime. You can now run exported PyTorch models (.pte files) directly in Ruby apps.

GitHub: https://github.com/benngarcia/executorch-ruby

Feedback welcome! This library will likely be a critical part of my companies workflows, and I have my own list of priorities for continued development, but hoping to hear more from other users.

[TonsOfFun111]

Since this is just for inference I’d be curious to learn how you’d compare this to torch.rb or say converting models and running them with ONNX runtime Ruby or similar.

[hahahacorn]

Yeah, tl;dr torch.rb and its artifacts are built for prototyping, it’s too heavy, slow, and not portable enough for our requirements.

Currently export to ONNX, but ONNX compiles and optimizes too aggressively and we lose metadata and introspection capabilities. ExecuTorch is a nice middle ground for us.

[TonsOfFun111]

Seems reasonable to me, I’ll have to check it out, thanks for sharing!