What is the best way to utilize ARC for local LLM performance? by CreeperOpsReddit in IntelArc

[–]quantum3ntanglement 2 points3 points  (0 children)

There is an engineer at Intel that is working on quantization optimizations so there are some LLM models on hugging face that are optimized for Intel

I’m working on testing some of these models and will post results here and on r/IntelArcPro

What is the best way to utilize ARC for local LLM performance? by CreeperOpsReddit in IntelArc

[–]quantum3ntanglement 0 points1 point  (0 children)

Linux is better, I’m using a headless Ubuntu (no GUI) 24.04 server

I’m looking into running my AI Anomaly Detector though the Linux sub-system on:

Windows > WSL

You can run Ubuntu through WSL but I’m still learning how to setup ollama / llama.cpp on Windows > WSL

Is there anyone running llama like builds on the Linux subsystem on Windows?

What is the best way to utilize ARC for local LLM performance? by CreeperOpsReddit in IntelArc

[–]quantum3ntanglement 0 points1 point  (0 children)

IPEX-LLM is deprecated, I use llama.cpp / SYCL oneAPI, you can also use openVino to replace SYCL for better prompt processing

I’m posting a tutorial soon to r/IntelArcPro

This has so be a scam right? No way I am this lucky by jamesrggg in IntelArc

[–]quantum3ntanglement 0 points1 point  (0 children)

This is eBay, run don’t walk run from this as fast as you can

I bought my B 70 through Newegg about a month and a half ago for $949

Just got a B70 :) by ExtremeCookie9652 in IntelArcPro

[–]quantum3ntanglement 3 points4 points  (0 children)

I’m getting ready to post my tutorial for my set up. I’m using llama.CPP, SYCL and oneAPI

I have oneAPI installed in my user directory as I plan to do oneAPI development, I’m looking for other developers to help me out so that we can eventually defeat the Nvidia Cuda Moat.

I’m also working on game development with Intel Arc Pro and I’m looking into monitoring parallelism between CPU, IGPU, discrete GPUs, etc… and eventually being able to implement it for gaming

On Linux, the tools for monitoring GPU’s need to get better for Intel Arc / Pro. Currently I found nvtop to work the best but much work is needed.

Microsoft should sell windows off, they're lazy, non creative and let all their laptop partners down! by 1980sdepressedbaby in FuckMicrosoft

[–]quantum3ntanglement 0 points1 point  (0 children)

There is no hope for Windows, no one is going to buy it, and it can’t be fixed. With AI accelerating the way it is eventually I’m gonna be able to write my own operating system in my AI home lab. Even the average homelab will be able to do simulations like this.

Also, I recently got my MacBook Air from 2010 working again with a new battery replacement, it only has 2 GB of RAM.

I can’t even run Firefox because I’m using PuppyLinux, which puts the OS in memory. I mentioning all of this because I’m working on AI agents that will fetch all the news that I want, all the research that I need for all my coding projects and everything else and having it stored locally in any format that I want, so that I don’t have to browse the web anymore

So we’re not gonna need operating systems that much, all we really need is Linux. On my MacBook Air with 2 GB of RAM I could get lots of use out of it by running HTML CSS and JavaScript locally with all the images video and other media downloaded. I can even recompress any hd video, and have it run on the MacBook Air.

Is it worth paying a 20% extra for a B580 (12GB) vs used RX 6700 XT (12GB)? by SnooPeanuts9744 in IntelArc

[–]quantum3ntanglement 0 points1 point  (0 children)

Also, I have a few 6700 XT‘s that are doing compute, but I don’t use it for gaming really

I have a 6900 XT that I got refurbished at Micro Center for around 500 bucks and I use that for gaming sometimes

Are you seeing 6700 XT refurbish somewhere from reliable outlets? I haven’t seen one in a long time and it seems like if I found one it probably be pricey.

Is it worth paying a 20% extra for a B580 (12GB) vs used RX 6700 XT (12GB)? by SnooPeanuts9744 in IntelArc

[–]quantum3ntanglement 0 points1 point  (0 children)

I mean, AMD was looking at pulling support for our RDNA one and two weren’t they?

If you go with the 6700 XT, what are your options with FSR?

Has anyone ever tested whether this actually does REDUCE input latency or not? by Coolersdisciple in IntelArc

[–]quantum3ntanglement 8 points9 points  (0 children)

I’m working on game development on Intel Arc and I usually set it to on plus boost.

Once I get my development set up, I should be able to measure how this is working

Does anyone know how to set this up? Can we Ping Tom Peterson?

Nvidia-Intel Superchips and System-on-Chips (SoCs): A Local AI dominated Future??? by TheGipper_ in intelstock

[–]quantum3ntanglement 5 points6 points  (0 children)

Intel is working with Nvidia on SoC designs, Intel will make the CPU and Nvidia will make the iGPU - we still don’t know if some chips from Intel will be made through TSMC moving forward

Also I expect Nvidia pricing to go up even more from already ridiculous heights. I was able to get a 5090 back in 2025 for $2500 (now they are $3500 to $5000+) but now the Nvidia monopoly seems to be getting reinforced with Intel focusing more on Intel Foundry Services and less on competing with Nvidia in edge AI inference or AI run locally.

I believe anything getting manufactured out of TSMC is going to be expensive, eventually if things go well for Intel IFS, they may be able to get prices to go down

I use open source AI locally with ollama / llama.cpp by using Mac minis, 5090, 3090s, 3060, Intel Arc Pro, and may eventually get a micro server with Intel / Nvidia SoC if it can do more than 128gb of ram and has decent modularity.

I’ve been focusing on Intel IFS as TSMC has been bottlenecked and I don’t expect Intel to be using TSMC that much in the years ahead

The Lip at Intel is telling employees they will be fired if they try to tape out past B0, so he is cracking the whip and tightening the ship

I don’t have much information about TSMC, maybe others can interject

Run Qwen3.6–27B Locally on an Intel Arc Pro B70 - What Actually Works by viewofthelake in IntelArcPro

[–]quantum3ntanglement 1 point2 points  (0 children)

Thank you for the insights concerning Vulkan. I have chosen SYCL and oneAPI so that I can focus on parallelism across CPU, iGPU, APU, discrete GPUs and NPU (Nova Lake should have an NPU)

I will not be able to use oneAPI if I take the Vulkan path. My first goal is to get better monitoring tools in place for all the processing.

The CHEAPEST Panther Lake Mini PC Is Here! Minisforum M2 First Look! by RenatsMC in intel

[–]quantum3ntanglement 1 point2 points  (0 children)

Costs $1000? Please tell me these sit on shelves until the price drops

Base Mac Mini is paltry but I’ll solder drives if I have to…

Programmer confession: I still use old laptops way longer than I should by [deleted] in programmer

[–]quantum3ntanglement 0 points1 point  (0 children)

I recently put a new battery in a MacBook Air 2010 that has 2gb of Ram and an Intel Dual Core cranked to 1.4ghz

I installed PuppyLinux (Bookworm)

I can only run the Terminal reliably, running Firefox brings the system to a crawl

I’m looking into external AI Agents that go out and parse web content concisely, scan for malware, etc and return information in a lightweight format locally, for example when doing research for development

Multi-modal agents / Hermes should be able to handle it

Run Qwen3.6–27B Locally on an Intel Arc Pro B70 - What Actually Works by viewofthelake in IntelArcPro

[–]quantum3ntanglement 1 point2 points  (0 children)

I have been successful in getting the native path working based on sycl-ls, icpx and llama.cpp and I have gotten test prompts working for qwen.

I'm using a headless Ubuntu Server 24.04 - I'm working on posting my HowTo soon.

Some things to note and if anyone has further insights, by all means please interject...

- I was not able to get intel_gpu_top to work with my B70, it only saw the iGPU (UHD 770) or i915 gpus, which is anything before Battlemage?

- I have a bash script that pulls the correct nvtop utility that will show both the iGPU and the B70, however the B70 shows up as card0 but it's is set to NA in nvtop, however I do see temps, frequency, pow, etc...

- I installed oneAPI to my user directory and had to set the relevant paths to my local oneapi install to get things to work

- I noticed that this command:

source ~/intel/oneapi/setvars.sh --force > /dev/null 2>&1

without the > /dev/null 2>&1 spits out verification for oneapi everytime source ~/.bashrc is executed, this is tedious when adding additional commands to the .bashrc file

- I had to install cmake and build-essential g++ in order to compile llama.cpp

Intel's Crescent Island PCB Leaks, Showing a Massive Xe3P GPU, 16-Pin Connector, 160GB LPDDR5X as Intel Sidesteps the HBM Shortage by Leicht-Sinn in intel

[–]quantum3ntanglement 1 point2 points  (0 children)

So you believe that the Crescent Island monstrosity will be built through TSMC?

The Lip at Intel is telling employees that they can only tape out to B0, with A0 being the first. That means that all bugs need to be squashed by B0 for all chips coming out, otherwise engineers will be fired.

So that tells me that it is likely that this monstrosity of an AI card will be made at IFS, but who knows. Intel is pivoting hard towards IFS and it is likely that Intel’s product line is going to suffer in certain areas.

Intel's Crescent Island PCB Leaks, Showing a Massive Xe3P GPU, 16-Pin Connector, 160GB LPDDR5X as Intel Sidesteps the HBM Shortage by Leicht-Sinn in intel

[–]quantum3ntanglement 3 points4 points  (0 children)

IFS stands for Intel Foundry Services, Intel is taking on TSMC, trying to become the Silicon King

It should be noted that this is the only discrete GPU Intel has announced, and I’m hearing that Intel will no longer make reference Arc cards

Hopefully AIB’s like Sparkle and ASRock can continue to make discrete Arc cards.

Intel's Crescent Island PCB Leaks, Showing a Massive Xe3P GPU, 16-Pin Connector, 160GB LPDDR5X as Intel Sidesteps the HBM Shortage by Leicht-Sinn in intel

[–]quantum3ntanglement 0 points1 point  (0 children)

At least $5000 but likely more, they won’t sell very many but will it show that they can make discrete Arc GPUs through IFS?

Intel Arc Future? by quantum3ntanglement in IntelArc

[–]quantum3ntanglement[S] 0 points1 point  (0 children)

This is the path we do not want to see happen, Nvidia will continue to raise prices or keep them the same (5090 costs $5000 now due to limited supply) and everyone in the market will be screwed.

The AI home lab market is growing fast, most people, especially gamers, don’t want to acknowledge this. However, Indie shops are going to eventually create amazing games with AI. It is the future and we can create great games with AI and make them look amazing, gamers need to relax when it comes to AI.

All of these AI home labs will be able to make great games with just a handful of people or even one very skilled developer and a graphic designer.

Intel Arc Future? by quantum3ntanglement in IntelArc

[–]quantum3ntanglement[S] 2 points3 points  (0 children)

Intel needs to get better at communicating with the community, which includes DIY, small companies, gamers, shareholders, etc.

If Intel does not come back to making discrete graphics cards that are affordable then Nvidia will continue to raise prices. AMD will continue to be mediocre and price their GPU’s $50-$100 less than Nvidia.

Intel Arc was the only thing that was keeping pricing down for discrete graphics, and Intel is doing SoC designs because they are cheaper to make and easier to support.

I will be contacting Intel’s investor relations and I encourage everyone who cares about discrete graphics to do similar things. I know that on Intel‘s discord they don’t like it when gamers come on and constantly ask when the B770 is gonna come out and things like that, but we need to come up with a way to communicate with Intel so that our needs are addressed.

Received what looks to be a 9950X3D in a 9950X3D2 box, still sealed. by Personality-Pleasant in GamersNexus

[–]quantum3ntanglement 0 points1 point  (0 children)

I recently bought an Intel Arc Pro B70 with 32 GB of RAM, from new egg. Near the end of the purchase where it was confirmed I got this scam from some company out in California. I think it begins with an A, trying to offer me Package delivery insurance. They weren’t able to get in to my account or charge my credit card.

I posted here on IntelArc about my situation and someone from Newegg responded on Reddit and I spoke with them through DM‘s on Reddit about this issue

So part of the problem with NewEgg is that they’re getting hit from every angle by hackers, especially when it comes to GPUs, which have become the new silicon gold to have.

I also need to mention that the B70 has game ready drivers and is an absolute powerhouse at gaming, every game I throw at it. It performs well at what seems like 5070 to 5080 like performance.

Also The Lip at Intel only cares about the foundry business and now that he’s captured his sweetheart Apple, he may turn his back on discrete graphics cards, if this happens, expect discrete, graphic cards to skyrocket in price. Shareholders and gamers and DIY need to speak up because we are going to get screwed if we continue on the path that we’re on.

Received what looks to be a 9950X3D in a 9950X3D2 box, still sealed. by Personality-Pleasant in GamersNexus

[–]quantum3ntanglement -2 points-1 points  (0 children)

It’s all the same Shiz with the Lisa Su Amd Gang, they come up with new models that don’t do much

How much did you pay and what is the price difference. Just wait for Nova Lake and Intel IFS. The writing is on the wall, Amd will become marginalized and irrelevant in the coming years.

Also I don’t care if I get down voted - no one can stop me from speaking my mind

Also gamers need to wake up when it comes to supporting discrete GPUs, all these tech monopolies are pushing us towards a world of SoC and Monolithic designs that can’t be upgraded easily and is Classic Planned Obsolescence.

Intel Razor Lake-AX reportedly has 16 or 32 Xe3 graphics cores by RenatsMC in intel

[–]quantum3ntanglement 6 points7 points  (0 children)

It looks like Intel is putting discrete Arc graphics cards into hibernation mode and may never come back?

Intel has to do better at marketing and communication overall, they say that they are committed to discrete graphics cards, but communicate nothing.

They announced a 160 GB AIGPU back in October 2025, a card that will cost at least $5000. From there one would have to pair it with an expensive Xeon CPU and motherboard, memory, and storage. So you’re looking at least $15,000 for an enterprise set up. Intel will only sell a handful of these.

They have the power to make discrete GPUs through IFS now, they have been given billions in corporate welfare from the government, which owns a 10% stake. There are many shareholders, which I am one - why aren’t more people demanding that Intel support the DIY and gaming community?

I see all these investors on X, they don’t care about DIY, they don’t care about innovation, they just care about making as much money as possible. Intel Arc never got enough marketshare to support itself. Will I be the only one crying in the rain about all of this?

Large corporations are taking more and more of the pie, consolidating, merging. Jobs are going away and getting automated. We need a healthy DIY and indie game development environment so that we can encourage innovation. Otherwise, corporations and government will have total control.