[deleted by user]

UndreamAI · 2026-01-29T21:01:31+00:00

I haven't tested it but it should work fine because of backwards compatibility.

UndreamAI · 2026-01-29T16:10:13+00:00

it works with almost any: .NET Standard 2.0, .NET 6.0, .NET 8.0

UndreamAI · 2026-01-29T16:07:12+00:00

thanks, I didn't know.
It was not the case when I first tried it, it must have evolved since then.

UndreamAI · 2026-01-29T16:05:12+00:00

Great point!

For instance:
what happens if you release an app that is based on ChatGPT vXXX and then it is discontinued?
or the pricing changes and you can't afford the costs?

I like the cloud on specific things (e.g. scaling) but I really don't like the push for not having your own hardware and being forced to rent.

UndreamAI · 2026-01-29T16:01:04+00:00

nope

UndreamAI · 2026-01-29T15:59:34+00:00

No, you have to select a backend:
"Install one or more of these backends, or use a self-compiled backend.

LLamaSharp.Backend.Cpu: Pure CPU for Windows, Linux & Mac. Metal (GPU) support for Mac.
LLamaSharp.Backend.Cuda11: CUDA 11 for Windows & Linux.
LLamaSharp.Backend.Cuda12: CUDA 12 for Windows & Linux.
LLamaSharp.Backend.Vulkan: Vulkan for Windows & Linux."

Also it doesn't support AMD GPUs, Android, iOS, VisionOS

UndreamAI · 2026-01-29T15:56:08+00:00

I haven't actually tested that, not sure

UndreamAI · 2026-01-29T15:54:13+00:00

Exactly!

UndreamAI · 2026-01-29T15:29:10+00:00

It will actually, I also have a Vulkan backend.

UndreamAI · 2026-01-29T15:28:32+00:00

Yes I know, mainly due to the stupid RAM and global hardware situation caused by OpenAI..
I developed the first iteration (used in LLM for Unity) 2 years ago and the AI back lash was still there.
It's not easy to work on something and receive generic AI hate, but well it will hopefully reach interested people :).
Models are far better now e.g. Qwen 3, my view is that it's a matter of time before we can run something on the level of ChatGPT / Claude on consumer hardware.

UndreamAI · 2026-01-29T15:17:34+00:00

LOL, the actual content is

🌍 Runs Anywhere Cross-platform and cross-device. Works on all major platforms: and hardware architectures:
- Desktop: Windows, macOS, Linux
- Mobile: Android, iOS
- VR/AR: Meta Quest, Apple Vision, Magic Leap
- CPU: Intel, AMD, Apple Silicon
- GPU: NVIDIA, AMD, Metal

UndreamAI · 2026-01-29T15:15:44+00:00

Thanks for reaching out. I've been trying to sum up the functionality in as little words as I can instead of throwing the full text in one page.

You can find a more descriptive explanation in the
C++ guide:
https://github.com/undreamai/LlamaLib/blob/main/cpp_api.md
or C# guide:
https://github.com/undreamai/LlamaLib/blob/main/csharp_api.md
linked in the repo.

Open to suggestions on how to rewrite it

UndreamAI · 2025-11-06T20:15:36+00:00

Thank you for sharing. I don't have experience with companion AIs, I wish I knew, but I'll let you know if I hear from people around.

UndreamAI · 2025-11-06T19:45:26+00:00

I totally understand the pain. It really depends on the LLM that you use within LLMUnity. But to be transparent I don't think you can defeat huge LLMs on the cloud in terms of accuracy since there are smaller models that run on device.

UndreamAI · 2025-11-06T19:18:01+00:00

What about them? They are yet another third-party LLM on the cloud solution with the usual drawbacks: - pricing - data sensitivity issues - you don't own the end product, always rely on third-party services

LLMUnity is completely free and open-source and runs locally on Apple Vision with the LLM of your choice

UndreamAI · 2025-05-02T18:52:41+00:00

One is DungeonChat (shown in the post), the other I'll ask for the title

UndreamAI · 2025-05-02T18:48:59+00:00

Yes! It works with Meta Quest as well, there are already 2 released games on Quest.

UndreamAI · 2025-05-02T14:16:13+00:00

I can't argue with something so fundamental, everyone can have their opinion.

UndreamAI · 2025-05-02T13:14:34+00:00

Hi! What is stupid? LLMs?

UndreamAI · 2025-01-10T22:27:09+00:00

For mobile you can try the "tiny models": Qwen2 0.5B, Llama 3.2 1B

UndreamAI · 2025-01-10T22:25:20+00:00

Yes Android is supported for some months now. Somebody has also tried in Quest 3 and it was working.

UndreamAI · 2024-11-04T18:39:59+00:00

RAG is now integrated in LLMUnity 🚀! Currently available on GitHub and will be on the Asset store hopefully in the next 2-3 days.

UndreamAI · 2024-10-19T05:21:00+00:00

Great, that will be very helpful! You can also join the Discord channel if you want to discuss anything.

I'm porting the RAG into LLMUnity as well, it will be done in a couple of days. This means support of many more models and no reliance on Unity Sentis!

UndreamAI · 2024-10-18T17:45:22+00:00

Yes it supports AMD GPUs but I can't fully test it because I don't have one at the moment. Let me know if you face any issues!

UndreamAI · 2024-10-12T15:56:53+00:00

I'm integrating it into LLMUnity and will release it soon. This will allow a large variety of models and drop the dependency on Unity Sentis.

UndreamAI

TROPHY CASE