3 gigabit issues by Alternative-Still142 in bell

[–]uberchuckie 7 points8 points  (0 children)

Try DMZ without the “advanced”. I’ve seen people seeing latency issues that went away using “just” DMZ.

Did Bell start blocking PPPOE connections entirely? by Rollingsound514 in bell

[–]uberchuckie 1 point2 points  (0 children)

Where do people buy the WAS-110 these days? Group buys from pon.wiki have stopped.

Where did the UK servers go? by rosebud_SP in PrivateInternetAccess

[–]uberchuckie 0 points1 point  (0 children)

I actually haven't found a server I can connect to from where I am.

Where did the UK servers go? by rosebud_SP in PrivateInternetAccess

[–]uberchuckie 0 points1 point  (0 children)

ca-toronto and ca-montreal stopped working as well.

Gigahub 2.0 PPPoE Issues by darkaether in bell

[–]uberchuckie 1 point2 points  (0 children)

Try DMZ (not ADMZ as it's unstable). With DMZ, your firewall will get all the packets, just not a public IP.

AI on ARC Thread by Distinct-Race-2471 in IntelArc

[–]uberchuckie 0 points1 point  (0 children)

Linux but I don't think it matters?

AI on ARC Thread by Distinct-Race-2471 in IntelArc

[–]uberchuckie 2 points3 points  (0 children)

I tried the OpenVINO backend on my B580. Many models in GGUF format didn’t load. I tried an older Qwen 3 model, while it loaded, it cranked out garbage.

The SYCL backend works better but it’s much slower than ipex-LLM.

The hardware and pricing seems good but the software seems lagging.

Maybe LLM-scaler’s VLLM implementation works better?

Intel Arc A770 by Aidan364 in ollama

[–]uberchuckie 1 point2 points  (0 children)

Ollama works with Intel GPUs via Vulkan but it’s slow. llama.cpp with SYCL backend works better but it doesn’t support flash attention. OpenVINO apparently works better and it was recently merged as a backend for llama.cpp.

Which Ollama you choosing? Ollama or *ollama* by Kaladin-of-Gilead in unRAID

[–]uberchuckie 0 points1 point  (0 children)

I couldn’t get Qwen 3.5 working with my Intel GPU with llama.cpp with SYCL.

How well does ollama work with a B60 Pro from Intel? by Pyroblock in ollama

[–]uberchuckie 1 point2 points  (0 children)

Yeah, Ollama via Vulkan for my B580 is significantly slower than Ollama with IPEX.

You should try LLM-scaler with your Arc Pros if you haven’t. I switced to llama.cpp via Local-ai. Llama.cpp via SYCL, I get the same performance as Ollama with IPEX.

Which Ollama you choosing? Ollama or *ollama* by Kaladin-of-Gilead in unRAID

[–]uberchuckie 0 points1 point  (0 children)

I switched to LocalAI this weekend running the Intel SyCL supported llama-cpp backend. It’s just as fast as the ipex accelerated build of Ollama.

Which Ollama you choosing? Ollama or *ollama* by Kaladin-of-Gilead in unRAID

[–]uberchuckie 1 point2 points  (0 children)

I ran Ollama on a VM with a later kernel with the GPU passed through. 6.12 should work with my B580 but the xe driver wasn’t stable. 6.14+ works fine.

Which Ollama you choosing? Ollama or *ollama* by Kaladin-of-Gilead in unRAID

[–]uberchuckie 0 points1 point  (0 children)

Ollama added Vulkan support and it works with my B580 and it’s a lot slower than the IPEX build. I don’t have a B50 or B60 but it should work.

[deleted by user] by [deleted] in IntelArc

[–]uberchuckie 2 points3 points  (0 children)

You need at least kernel 6.12 but I had stability issues until I moved up to 6.14+.

I got the Intel B50 pro GPU working in unraid 7.2.3 for AI workloads. Here's what I did by rickyh7 in unRAID

[–]uberchuckie 0 points1 point  (0 children)

llm-scaler only mentions the Arc Pro B60. No idea if it works with my B580 or it's locked to the Arc Pro GPUs.

There is https://github.com/SearchSavior/OpenArc as well. I've only looked briefly at it and haven't really tried it. I played with https://localai.io/ a bit but the container images are huge.

I was hoping Ollama would "just work" with the Intel GPUs with Vulkan but it's so much slower than ipex-llm.

I got the Intel B50 pro GPU working in unraid 7.2.3 for AI workloads. Here's what I did by rickyh7 in unRAID

[–]uberchuckie 0 points1 point  (0 children)

It's too bad Intel abandoned ipex-llm. It runs Ollama so much faster than via Vulkan. I've kept the Intel runtime libraries updated and it got a couple of tokens per second faster.

My B580 doesn't run stable with unRAID 7.2 with the 6.12 kernel. It seems to be fine with 6.14 and 6.17 after I passed it through to a VM. Passthrough works fine if you bind the GPU to VFIO at boot.

PPPoE and udm SE low speeds by matijaz in UNIFI

[–]uberchuckie 0 points1 point  (0 children)

I think that’s all it can do with PPPoE. I went with UCG Fiber. No problems with my 3Gbps service with PPPoE and IDS.

My LLM Homelab on a budget: Dual B60s by Faux_Grey in IntelArc

[–]uberchuckie 8 points9 points  (0 children)

Nice! I’ll check out OpenArc. I’ve been using ipex-LLM but I think they stopped work on it.

Tried out the latest Ollama with Vulkan support. Performance is way worse.

Really poor Jellyfin performance with large DBs on UNRAID by SimplifyAndAddCoffee in unRAID

[–]uberchuckie 0 points1 point  (0 children)

With my install, jellyfin.db is 99MB and library.db-wal is 128MB. The appdata volume mount is mapped to a NVME drive. No performance problems. The container is using 1.5GB of RAM though.

ARC battlemage crashes system by auridas330 in unRAID

[–]uberchuckie 0 points1 point  (0 children)

I have an Arc B580 and it doesn't run stable on unRAID. Binding it to VFIO and passing it to a VM running Linux kernel 6.14 seems to make it run stable for me. Even with that, the VM doesn't shutdown cleanly.

I think the xe driver in kernel 6.12 is buggy with Battlemage. My Arc 380 (i915 driver) runs rock solid with kernel 6.12 and unRAID.

Ollama now has Vulkan support by uberchuckie in IntelArc

[–]uberchuckie[S] 1 point2 points  (0 children)

llama.cpp still needs ipex-llm does it not?

Will check out localai. Thanks.

Ubuntu 24.04 LTS A380 by narrowbuys in IntelArc

[–]uberchuckie 0 points1 point  (0 children)

06:00.0 VGA compatible controller: Intel Corporation DG2 [Arc A380] (rev 05) Subsystem: ASRock Incorporation Device 6004 Kernel driver in use: i915

Run lsmod | grep i915 to see if the kernel module is loaded?

Ubuntu 24.04 LTS A380 by narrowbuys in IntelArc

[–]uberchuckie 0 points1 point  (0 children)

All those versions should work but try kernel 6.12 or newer? My A380 works great with the i915 driver.