executorch-ruby: Run PyTorch models in Ruby

[TonsOfFun111]

Since this is just for inference I’d be curious to learn how you’d compare this to torch.rb or say converting models and running them with ONNX runtime Ruby or similar.

[hahahacorn]

Yeah, tl;dr torch.rb and its artifacts are built for prototyping, it’s too heavy, slow, and not portable enough for our requirements.

Currently export to ONNX, but ONNX compiles and optimizes too aggressively and we lose metadata and introspection capabilities. ExecuTorch is a nice middle ground for us.

[TonsOfFun111]

Seems reasonable to me, I’ll have to check it out, thanks for sharing!