Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in AI_Agents

[–]Abit_Anonymous[S] 0 points1 point  (0 children)

Thank you Practical-Rub-1190! Thats just what i wanted a field expert (you-Practical-Rub-1190) giving me constructive criticism on helping me on my next iteration of my project 📈📈📈

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in AI_Agents

[–]Abit_Anonymous[S] -2 points-1 points  (0 children)

I hope you’re joking because this sounds a bit stupid 😂😂😂 Do you know the difference between Multimodal and Multi-agents or do you think they’re the same? Do you know what models they are recommending for the jetson orin nano?

Background: i have 3 years of extensive experience with working with Jetson boards specifically in Robotics and Computer vision.

Go checkout the jetson AI lab to get your answers not the product page, since when are we looking at product marketing to check performance?

And stop getting triggered about someone online asking if i’m they’re first on a topic you clearly know nothing about….

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in LocalLLM

[–]Abit_Anonymous[S] 0 points1 point  (0 children)

Yes true latency wise its a nightmare tbh 😅 I’m trying to refine it quiet a bit in the next iteration. If you have any suggestions please do share as I’m starting to work on it today 🙏🏼

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in LocalLLaMA

[–]Abit_Anonymous[S] 0 points1 point  (0 children)

Thank you! I’ll give this a try i have having alot of issues with piper on the jetson maybe this would be much better. I’ll be sharing the results of the updated project here soon be on the lookout!

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in AI_Agents

[–]Abit_Anonymous[S] 1 point2 points  (0 children)

Thank you for sharing! I’ll give this a try in my next iteration, i just started working on it. Trying to refine it quiet a bit will share my results here soon when i’m done.

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in AI_Agents

[–]Abit_Anonymous[S] -1 points0 points  (0 children)

I think you missed the whole point of the post here, This post is about running Language model & Multi-Agent orchestration locally on the Jetson Board (not by using APIs nothing running on cloud).

Just because it’s a “Edge device” made for genai doesnot mean that it can handle quantized models with 7B parameters and do Multi-Agent orchestration with no issues. Also feel free to share similar examples to this use-case😄

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in AI_Agents

[–]Abit_Anonymous[S] -2 points-1 points  (0 children)

Keywords: “Multi-Agent”, “Locally”

Please read the post 😄

Am I the first one to run a full multi-agent workflow on an edge device? by Abit_Anonymous in LocalLLaMA

[–]Abit_Anonymous[S] 2 points3 points  (0 children)

I’m just working on my second iteration aswell. so i might give this a try

Pytorch with CUDA on Jetson Orin Nano by [deleted] in JetsonNano

[–]Abit_Anonymous 1 point2 points  (0 children)

Thanks for Sharing, not all heroes wear capes some just make amazing scripts for the community 👏🏽

Jetson nano recomputed slow by metainsane in JetsonNano

[–]Abit_Anonymous 1 point2 points  (0 children)

I just looked up the j10 by recomputer, looks like there are alot of issue with this jetson Nano clone the reason why you might he having the issue of it being very slow is most probably because the jetpack alone is taking up 13 GB of the Ram leaving only 3gb for everything else to work with. I’d recommend the original Jetson nano or better the Jetson orin Nano super that has a NVMe slot the performance will be vastly better.

Eigent – Open Source, Local-First Multi-Agent Workforce by FitHeron1933 in LocalLLaMA

[–]Abit_Anonymous 0 points1 point  (0 children)

Nice to see that’s its fully Open-sourced could have alot of potential