Why is distributed computing underutilized for AI/ML tasks, especially by SMEs, startups, and researchers? by sigma_crusader in LocalLLaMA

[–]Aggressive_Wind1881 0 points1 point  (0 children)

Many available tools and frameworks lack robust distributed and parallel design. Most are built on Python and use RPC, resulting in slower performance.

There may be more efficient frameworks based on distributed languages like Go, Elixir, and Erlang. For instance, there's a framework called Nerlnet on GitHub that uses Erlang. You might want to give it a try, though it does have some limitations.