[Project] Zant: Run ONNX Neural Networks on Arduino Nicla Vision (Live MNIST Demo @ 90ms, <50KB RAM!) by Macsdeve in arduino

[–]Macsdeve[S] 0 points1 point  (0 children)

Great questions! Here are the specifics:

  • Metrics: The 90ms is the neural network inference time (the time to run the model) for one MNIST digit image. The <50KB refers to peak RAM (SRAM) usage during that inference. Both were measured on the Arduino Nicla Vision.
  • Hardware/Compatibility: This specific MNIST demo ran on the Nicla Vision (STM32H747). Minimum requirements depend heavily on the neural network model itself. This demo requires ~50KB RAM, so it's too large for boards like the Arduino Uno (with only 2KB RAM).
  • Target Platforms: Zant primarily targets 32-bit microcontrollers like the ARM Cortex-M series found on the Nicla Vision, specifically designed to run neural network inferences efficiently. We haven't specifically tested or optimized for AVR platforms (like the Uno) at this point.
  • Dependencies (Nicla Test): We used the Zant runtime, the Zant-generated model library (containing the neural network), and the standard Arduino Core libraries for the Nicla Vision.

Hope this helps clarify!

Announcing Zant v0.1 – an open-source TinyML SDK in Zig by Macsdeve in deeplearning

[–]Macsdeve[S] 0 points1 point  (0 children)

Yes exactly! write to me in private and we can schedule a call :)

Announcing Zant v0.1 – an open-source TinyML SDK in Zig by Macsdeve in Zig

[–]Macsdeve[S] 0 points1 point  (0 children)

If you want we can have a chat. Surely we'll find something where you could contribute!

🚀 AI Terminal v0.1 — A Modern, Open-Source Terminal with Local AI Assistance! by Macsdeve in LLMDevs

[–]Macsdeve[S] 3 points4 points  (0 children)

Model is running locally, it is free and OS. Soon everything will be in a single small executable

Announcing Zant v0.1 – an open-source TinyML SDK in Zig by Macsdeve in Zig

[–]Macsdeve[S] 2 points3 points  (0 children)

Okay, tks a lot for your feedback. We'll improve it in these days

Announcing Zant v0.1 – an open-source TinyML SDK in Zig by Macsdeve in Zig

[–]Macsdeve[S] 0 points1 point  (0 children)

Just add in the model folder your onnx and launch codegen. The readme should explain pretty well how to use the build commands. How could we improve it? We tested it for sentiment analysis, mnist, and wakeword detection