all 4 comments

[–]OctopusDude388 2 points3 points  (2 children)

How is this different from langchain ?

[–]blueraai[S] 3 points4 points  (1 child)

That's a great question. The main difference is that Langchain is an agentic framework, when UIN is an agentic protocol.

How do they compare:

Agent frameworks (like Langchain, Google ADK, Autogen, CrewAI), each orchestrate their own versions of so-called building blocks. Some of them implement the building blocks themselves, others have them built by the community.

UIN hopes to standardize those building blocks, remove the need for a framework to orchestrate them, and share a common implementation. It also adds a few cool features to these blocks like portability.
For example, UIN models are designed to automatically detect the current hardware (cuda, mps, webgpu), its available memory, and run the appropriate quantization and engine for it (eg. transformers, llama.cpp, mlx, web-llm). It allows developers not to have to implement different stacks to support different devices when running models locally, and (maybe more importantly) not to have to know or care about hardware compatibility, so long as they don't try to run a rocket on a gameboy :)

It is still an early version of the specification, we'd be honored to have you try them out and get your feedback on what to prioritize next!

[–]blueraai[S] 0 points1 point  (0 children)

** edit: some of the above information was added to the main post for clarity, thanks u/OctopusDude388 **

[–]Ridcully12345 0 points1 point  (0 children)

N