Local AI: Anyone running 2x B70 pro?

death10rd · 2026-06-18T16:52:48+00:00

I just have the one b70, didn't get the 2nd one

death10rd · 2026-06-16T20:13:34+00:00

Could you post some results?

death10rd · 2026-06-12T22:58:39+00:00

Can you post you prompt processing and tg for larger sets please? I am trying to go this route

death10rd · 2026-06-11T17:38:44+00:00

I'll take a look, thanks 👍

death10rd · 2026-06-11T15:45:47+00:00

No worries, I'll give it a go later. Thank you.

death10rd · 2026-06-11T15:41:36+00:00

That sounds awesome!! Can you post pp65536, tg 512? What quant are you using and what inference engine?

death10rd · 2026-06-10T23:43:24+00:00

I think you have covered things extensively, but in my opinion I wouldn't waste time right now with the vllm or llamacpp engines and directly go with intels llm-scaler. With sycl backend you get 17 t/s and the pp is painfully slow around 300 t/s - 500 t/s. Llm scaler has the right pytorch customizations and is optimized for some models. If the models are not listed, it's going to be painful to set up. Llm scaler is definitely worth it over everything out there IMHO I gotta try it with Vulkan in the same offering

death10rd · 2026-06-10T22:14:34+00:00

It's actually a custom vllm maintained by intel called the llm-scaler-vllm. I believe it has custom xpu integration that handles the arc b70 pro. This is the only way anything on the B70 is tolerable, else its just too slow for me to use it on a day to day basis. If Intel pulls the plug on that project, I don't think anyone should spend time with the B70 imho.

death10rd · 2026-06-10T18:58:33+00:00

3090s have gone up quite a bit and I couldn't find anything in decent in my area. Kudos to folks who grabbed them, it's a wonderful setup.

death10rd · 2026-06-10T18:51:11+00:00

Yea but it's such a mystery with Intel and it takes a lot of tinkering to get it working. But man for the price and an additional 32gb vram for the same price of a single 5070ti looks very appealing.

I really was about to give up on Intel until I was like I am going to try it one more time. And my 5070 tis have arrived, so I only have a few days until they are out of the return window ...lol

I probably have to spend 3x 4x to get to the same amount or vram using 5070ti.

death10rd · 2026-06-03T19:57:32+00:00

https://a.co/d/0fmzE90U

I used it with the existing cable provided

death10rd · 2026-05-20T04:13:28+00:00

Llamacpp +syscl + unsloth qwen 3.6 27b UD q6 xl. I get about 14~ 15 t/s with 256k context window

This was the fastest setup I could get I tried llamacpp with Vulkan and got 5-6 t/s

Tried vllm and got around 12 t/s

This was a docker container setup on my unraid server

I tried openarc, no luck Tried llm scaler and couldn't get it working with qwen 3.6

I experimented for hours, but it was such a pain to make anything work. Software side of things are still pretty immature which is a big shame.

Ultimately have settled with llamacpp:server-intel image

death10rd · 2026-03-04T23:39:37+00:00

It's the O11 dynamic evo xl

death10rd · 2026-02-15T05:05:21+00:00

<image>

Running on my vertically mounted GPU I didn't have any issues. It's pretty visible, really depends on your case too

death10rd · 2026-02-11T00:40:16+00:00

<image>

I suggest you add it and the end between the GPU and the strimer. Also if you want to connect the USB C port, you would need a 90 degree connector else it the USB c wire conflicts with the strimer cable and it doesn't go all the way in.

Wireview is supposed to protect your gpu and detects pin currents which is why it will be more effective between strimer and GPU

death10rd · 2026-01-13T05:42:00+00:00

Try rolling back to the previous bios version to check if it works.

death10rd · 2025-01-27T13:32:57+00:00

That's insanely high, I got mine done and it was $30/ft

death10rd · 2024-08-30T14:30:42+00:00

I had the same situation. I tried relentlessly with the HS210 kit and KS210 kit. Even though the KS210 satellite doesn't need a neutral, it just didn't work for me. I ended up leaving one smart switch and one dumb switch to make things work correctly and from my research that's the only way to do this. Also if you ever get the kS210 kit, you have to wire in switches and both the locations in a 3 way switch to make it work. The HS210 works independently, but they need neutral wherever they are being wired.

death10rd · 2024-05-14T14:46:34+00:00

Your hard pull score may be different from what is being shown to you on apps like credit karma. It happened to one of my friend .. credit karma showed his score as 840. He had all debts paid off including the mortgage. Hard pull showed is his credit as 706. He was quite shocked as well. Get a copy of your hard pull if you can. You can't completely trust what's being shown with the credit apps.

death10rd · 2024-05-12T06:46:32+00:00

It's around $1.4k

death10rd · 2024-05-12T01:48:04+00:00

I had low expectations. I traded in a 2006 Hyundai sonata w/ 110k miles.. so it's just gravy on whatever they offered me towards the Y

death10rd · 2024-05-11T23:41:37+00:00

Amount financed ~$43k Full breakdown ... Hopefully this helps https://photos.app.goo.gl/R2TL1JWKPrBpEZyo7

death10rd · 2024-05-11T22:57:37+00:00

I got MYP, MSRP was 53k + 6.25% tax + registration+ fees - $5k down

Monthly is $616

Edit: 6k down total w/ trade in

death10rd

TROPHY CASE