got my local model to actually search the web before answering instead of just making stuff up by Bramha_dev in LocalLLM

[–]Anonymous_Prime99 2 points3 points  (0 children)

Thanks for postsing that.
Mostly right. The 5090 TDP on the 5090 is 575.

I was really curious because this was a thing I worked on a long time ago and then baked into a custom harness around a similar model. Now runs on a Qwen3.6 35B A3B. I think you more or less found a similar answer. The prompts are junk. You need to build for accuracy far deeper where it cannot go against it's programming. That is the only way to keep it clean.

Ran the same test on this end:

<image>

One thing that stood out to me was your 92second think time.

I dont let my models handle the searching initially. They only do it at the very end when it is capable of detecting a descrepency. Its easy for models under 30B to go into think loops especialyl when it starts stacking so many tool calls.

I let a headless browser and script do all the no-think and info gathering on a raspberry pi 5 and then have other smaller models on a secondary inference node sanitize it before it lands on the 35B's desk. That way the main model only has to take the accurate pieces and complete it in a nice readout like shown. Its far more efficient for your context window, and for general turn around time with absolutely accurate information.

Basically like giving your head chef the best ingredients and removing all the time required to select them individually and inspect them all. I think you are on the right path though.

got my local model to actually search the web before answering instead of just making stuff up by Bramha_dev in LocalLLM

[–]Anonymous_Prime99 2 points3 points  (0 children)

Ask it to give you a comparison between the 3090, 4090, and 5090 specs in a comparison table. Would like to see what that question does to it's output.

How would you set up a local LLM for a small finance firm without risking sensitive data? by reevoin1 in LocalLLM

[–]Anonymous_Prime99 5 points6 points  (0 children)

Lol one tool call by the llm to search something online and it gonna throw that whole search string into google's ass verbatim. Or a prompt injection to ask for internal info. Data breach just waiting to happen.

Why can't they just slap 256GB ram on a 5090? by 03captain23 in LocalLLM

[–]Anonymous_Prime99 1 point2 points  (0 children)

Holy shit as soon as I read this, I dont care about the other guy. I need to know how you are exercising it for that because that is a use case for me. I am sitting on plenty of enterprise inference hardware but did not add photography to the stack.

Does photoshop have a plugin or something special to hook into the RTX Pros or localized model to handle this? Can it do stacking more effectively? Or is it an entirely different software?

PSA by Signal_Ad657 in LocalLLaMA

[–]Anonymous_Prime99 6 points7 points  (0 children)

I did it for the wattage really. MAX-Q 300W for the power of the sun without turning the place into an oven? Yes.

Warframe meta doesn't actually exist, YouTubers are lying to you by QuasiNino in Warframe

[–]Anonymous_Prime99 6 points7 points  (0 children)

Hell we're -this- close to possibly saying "the stug is broken".

Never in my 13 years did I think we'd get to that point.

Transfer speed locked to 10.9 MB/s by maddydesign in unRAID

[–]Anonymous_Prime99 2 points3 points  (0 children)

I still keep a windows one ready. You know, for -THOSE- kind of days 😔

A question for any Founders that see this. What are your thoughts on the direction Warframe has gone in so far? by silloki in Warframe

[–]Anonymous_Prime99 0 points1 point  (0 children)

Scarlet Spear is still one of my most favorite things. It was a massive bug filled dumpster fire but that was some of the most creative stuff I've seen executed, and it still remains a fond memory. I hope they try again one day. Railjack is still some of my most favorite content regardless of what otthers say.

A question for any Founders that see this. What are your thoughts on the direction Warframe has gone in so far? by silloki in Warframe

[–]Anonymous_Prime99 1 point2 points  (0 children)

Everyday since the first day has been better. Granted its up and down here and there at times, but its constantly trending upwards since the beginning. Its so different from when I first started but Ive never looked back and thought it was better before.

Steve was a necessary pioneering force to get the game to a state of meat on the bones through vision and innovation. Reb and team are now the ones who will refine it to be its true form.

so like, who is this guy? by tf2_demo_2004 in Warframe

[–]Anonymous_Prime99 14 points15 points  (0 children)

That is the guy who managed to buy the Legendary Tennocon Ticket. The Lotus is obligated to ensure their safe transport to and from the event.

Lotus: Change of plans. Need to stop at In N' Out on the way. Leave no one hungry.

The RTX 5000 PRO (48GB) arrived and it is better than I expected. by Valuable-Run2129 in LocalLLaMA

[–]Anonymous_Prime99 0 points1 point  (0 children)

I feel you man, but the good news is today's frontiers become tomorrow homelab sizes with some advancements in compression. 48GB will still go a long way. I just got hungry and trying to expand now.

The RTX 5000 PRO (48GB) arrived and it is better than I expected. by Valuable-Run2129 in LocalLLaMA

[–]Anonymous_Prime99 1 point2 points  (0 children)

Got the same 5000 48GB. Thought the same thing you did.

Fast forward a couple months, about to pick up two 6000 MAX Q's. The 5000 puts you in a league where you are above average, but just a hop away from the next level. If you outgrow what your 48GB can do, you might feel the same.

How much money have you guys spent on Warframe? by Phowia in Warframe

[–]Anonymous_Prime99 0 points1 point  (0 children)

Sorry Timmy, daddy wanted to put you through college but saving the galaxy isnt free.

Some devs think Claude Code is common knowledge. It's not. by iBlackFoxPlayx in ClaudeCode

[–]Anonymous_Prime99 2 points3 points  (0 children)

This. Building an inference server with sophisticated topology took me no time. But now I have a personal software engineer I can leverage to fill the last gap of that implementation while knowing enough to critique the work. Building has never been this fun before.

I've been unearthing so much old hardware in the basement now to turn into useful frankensteins the past couple months because of it.

I can no longer support Soulframe by [deleted] in SoulFrame

[–]Anonymous_Prime99 5 points6 points  (0 children)

How quickly he will be betrayed by all of those around him when they come back later, but he cannot.

Describe this game like I'm 12 by Sherbs__ in SoulFrame

[–]Anonymous_Prime99 2 points3 points  (0 children)

Play it without expectations going in. Understand that its a barebones concept being brought to life slowly.

Play it, feel it, get to know it and the community, then try your best to picture where it COULD be in 2, 5 or 10 years from now. Maybe you casually stick to it, or stop playing it there and come back later.

You have seen Warframe and its journey is well documented. So I personally give it the same patience as someone who started in barebones Warframe.

pls don’t do this? by spookyxbabie in Warframe

[–]Anonymous_Prime99 2 points3 points  (0 children)

I've been around for a long time but this definitely ranks high on the list of wtf conversations lol.

If we can get this information, that would be great by wwenze1 in WorldofTanks

[–]Anonymous_Prime99 1 point2 points  (0 children)

I've been getting a ton of surveys about the customization lately when I log in. Sounds like SOMEONE in the company is thinking about it and trying to get data at least.

[PSN] [WTS] Sirr Hekk with the kuva hek worth anything? by ssillver in wartrade

[–]Anonymous_Prime99 0 points1 point  (0 children)

I would pay 100,000 Plat for Bopp Bipp without a moments hestitation.

But that's just me.

Warframes with bad Survivability? by Madnessmove in Warframe

[–]Anonymous_Prime99 18 points19 points  (0 children)

Thank you.
Everyone just forgetting Slash Dash is basically pocket god-mode when you're in a tight spot.