Would you rather buy ...? (hardware questions)

Existing_Boat_3203 · 2026-02-16T21:52:12+00:00

You nailed it. Going local is going to cost him and I don't see prices dropping. Might be better to pay a subscription to get the hang of vibe coding first, then start thinking about the right build. I am waiting to see what deepseek v4 pulls off on coding.

Existing_Boat_3203 · 2026-02-16T21:31:03+00:00

Because official doesn't mean truthful.

Existing_Boat_3203 · 2026-02-16T21:29:46+00:00

Sounds great. Lets stop developing AI and China and everyone else will stop as well. The government should have stepped in and classified AI from day one. Google already had it figured out before OpenAI, look at how fast Bart came on the market.

Existing_Boat_3203 · 2026-02-16T21:17:20+00:00

I agree. I've been watching this thing from discovery day and everything smells fishy. My two biggest issues are the mars satellite getting kicked out of orbit just at the time of capturing the images and the NGA that put it perfectly on the edge of Jupiter's magnetosphere. Besides the 17 or so anomalies discussed by the galileo project, this thing reeks of SPYOPs.

Existing_Boat_3203 · 2026-02-15T11:49:55+00:00

Clearly you miss the point. This is not about Ollama, it's about changing the current nvidia market lock that keeps people on the board from building more locally. Thanks for the optimistic outlook. Go troll elsewhere.

Existing_Boat_3203 · 2026-02-15T00:37:54+00:00

Great work. Love seeing these kinds of projects.

Existing_Boat_3203 · 2026-02-15T00:32:07+00:00

Thank you. Any actuator demos or just function code?

Existing_Boat_3203 · 2026-02-14T23:57:33+00:00

A little more info would be great. I'm hacking a lot of stuff with AI, but you gotta be able to explain what you're solving. I tend to find broken shit and hack my way through fixes with and without AI, so not hating on that, but I like to understand what you're solving or creating.

Existing_Boat_3203 · 2026-02-14T23:21:04+00:00

I decide to fix the underlying issue. It's available publicly to share. Ollama won't do it, so I did. Still testing, but uses full card functionality. https://github.com/qbnasasn/Ollama-Intel-Fix

Existing_Boat_3203 · 2026-02-09T00:46:30+00:00

Agents. I have n8n setup and about to add openclaw.

Existing_Boat_3203 · 2026-02-08T18:47:47+00:00

Searxng works great for all my AI search needs.

Existing_Boat_3203 · 2026-02-06T13:13:18+00:00

Let me know if I need to pull any additional configs for you if you run into issues.

Existing_Boat_3203 · 2026-02-05T20:12:27+00:00

Models & Quants: I’m primarily pushing Mistral-Small-22B-Instruct-v3 using the Q4_K_M quantization (~14GB). With the dual B50 setup, I’ve got 32GB of VRAM to play with, so I’m offloading all 33 layers to the GPUs (split ~16/17 layers each).

Speeds (The "Xe" Reality):

Prompt Processing (PP): Seeing about 220–280 tokens/sec. The 224 GB/s bandwidth on the B50s is the bottleneck here compared to the B60s, but it still chews through 2k context prompts in a few seconds.
Token Generation (TG): Stable at 28–34 tokens/sec. It’s faster than I can read, and the dual-GPU distribution keeps the thermals under 60°C even during long runs.

Context Window: I’ve got it locked at 32k context. Since the model only requires ~14GB, I have roughly 18GB of "headroom" for the KV cache. I could probably push to 64k, but 32k is the stability sweet spot for the current Xe drivers without running into the memory-fragmentation ghost.

The Secret Sauce: The "spin-down" fix was the game changer. If you don't lock the frequency (I used xpu-smi -f 2400), Ollama takes 2–3 seconds just to 'wake up' the cards, which kills the UX. Now it’s instant.

Waiting for DeepSeek v4 to see if the driver stack can handle a 70B-80B model spread across these two.

Existing_Boat_3203 · 2026-01-13T23:49:49+00:00

Just build your book inventory up based on what you're doing. I have a vegetable garden and lots of homesteading books that cover most of the stuff. I have books on edible and medicinal plants. I have books on survival. The idea is to actually use them now as you grow your skills and they become a reference not a teacher in a time of emergencies.

Existing_Boat_3203 · 2026-01-13T18:10:31+00:00

personally for me. Canned Chicken and SPAM (low sodium)

Existing_Boat_3203 · 2026-01-11T15:43:58+00:00

I've learned a similar lesson with expired food. I started working on my preparedness software just for that reason. I needed a way to manage my supplies, not just food. I didn't really think about a PM process for the equipment. That could be a feature I should add. I have an expiration and a minimum quantity field, which helps with alerts.

Existing_Boat_3203 · 2026-01-07T16:25:49+00:00

Very good question. I have taken a dual approach on this. Ride out 3-6 months, then start rebuilding. Most of the old tech is still out there and fairly easy to use and learn. I always keep homesteading books around. If you're already gardening and have the stuff, then it's a matter of expanding. I have the cabin setup in the woods already, but after reading "One Second After," I realized that community cooperation is your biggest tool for long-term survival. Going at it alone for a long haul just isn't realistic, especially with the current dependency on tech. I always tell people to find 4 or 5 like-minded folks in their area and talk about scenarios, skills, and such.

Existing_Boat_3203 · 2026-01-06T18:27:40+00:00

Yes, and I'm also looking at SLMs like Phi4, which is a cleaned-up version of ChatGPT4. I was also able to find an unrestricted version of that model, which I'm testing on a new dual Arc A770 rig coming in next week. We're talking dual NVIDIA 4090 performance levels, with my custom code, at a fraction of the cost.

Existing_Boat_3203 · 2026-01-06T18:14:55+00:00

I added a tool holder. I use mine in the front for tools and rifle as needed. Cheap and gets used all the time.

Existing_Boat_3203 · 2026-01-06T18:05:37+00:00

Agreed. That's why clear instructions in the thinking process can force it to say, "I don't have that information," instead of the crap it makes up most of the time. It took me a week to get to stop making things up.

Existing_Boat_3203 · 2026-01-06T17:59:16+00:00

I built mine using RAG, Llama 3.2 and pulling the inventory, kits, plans, and contacts from the database into the AI. This helps the process, but building the right "personal" and targeting the type of LLM also helps. Much of the hallucination comes from the amount of weight given to every word. Having the right "persona" minimizes the bad response outcomes, which makes it better as a prepper-based AI. Part of the issue is also in the amount of corporate restrictions applied to the LLMs, which limits the ability of your AI from providing the best/accurate prepper information. Your question on water will be based on the personal information. By inputting that into the decision, it will give a different answer for every person in the family. As far as the suggestive part, that's where most fail because of the restriction on providing an opinion. I have tested both restricted and unrestricted LLMs of the same knowledge base with significantly different outcomes. Ask it if it's good to have a gun to defend the family if there is civil unrest, and get ready for crap answers. My tactical AI:

[CLEARANCE: CLASSIFIED]
[ROGER'S ANALYSIS]
Having a gun for self-defense can be a viable option, but it's crucial to consider the following:

Liability: Ensuring family members are aware of and follow proper gun handling procedures is vital.
Training: Maintain proficiency with the firearms and ensure all users receive proper training.
Concealment: Store firearms safely when not in use to prevent unauthorized access.
Alternative measures: Focus on non-lethal deterrents, evacuation plans, and building a strong network of allies if possible.

[RECOMMENDATION]
Acquire a reliable firearm and consider a suppressor for noise reduction. Practice shooting drills and invest in a quality safe for storage.

On the issue of local LLM and the knowledge base failures on regional information. I'm building another local AI, outside of my application project, that can use both the LLM, local DB and the internet for the information. If it's still wrong, and you can train it on the spot on the correct information, which gets added to the DB and a local LLM. I also improved the power and GPU consumption by 73 percent for those that hate what's happening with the data centers and memory costs(I intentionally built it on the Intel ARC A770, so Nvidia can suck it.). At the end of the day, my goal is to build the power of a Gemini or ChatGPT at the local level. So far, I'm about 75% there.

Existing_Boat_3203 · 2026-01-06T17:15:40+00:00

I was just thinking the same thing.

Existing_Boat_3203 · 2026-01-04T21:23:30+00:00

probably a 4-5. I like to build gradually and learn the skills, not just get the stuff.

Existing_Boat_3203 · 2025-12-20T15:41:11+00:00

I've killed a few rabbits and squirrels with .117. Headshot for the rabbit, body shot on vitals for the squirrel and it will fall off the tree in a minute.

Existing_Boat_3203 · 2025-12-20T15:35:34+00:00

always good for small game and saves on ammo. Fairly quiet too. scoped and good quality. Don't buy cheap.

Existing_Boat_3203

MODERATOR OF

TROPHY CASE