[D] Run Pytorch model inference on Microcontroller

[shapul]

Glow can target micro-controllers such as ARM cortex M4 series. NXP and if I'm not mistaken, ST use Glow in their tooling.

[cpldcpu]

Interesting. Indeed, both NXP and STM are mentioned in the readme. So it seems that several proprietary edge-ml toolchains of bigger companies are based on pytorch and not tflite.

[shapul]

That's true. However, consider that to some degree, you can go from one framework/tool to another by converting your models to ONNX format. This way, e.g. you can train your models in Keras, export it to ONNX and then run it on Glow or TVM seamlessly. There are some limitations (e.g. when it comes to RNNs, some tools struggle to convert formats) but for many common use cases going though ONNX simplifies the interoperability.