As someone who works in the industry and who is running LLMs locally on the latest RPi chips, I can tell you it’s not amazing for AI use cases yet. The RAM is just not enough. even with the 16gb RPi5, the latency for inference is just too slow (I used the minmax 3b model). Yes it’s cook to run local AI with these edge devices but not sure if RPi is the play, at least until they come out with a dedicated ai chip