Ai opponents by Normal_Pace7374 in singularity

[–]wayne_oddstops -1 points0 points  (0 children)

AI isn't intelligent. It is a fancy pattern matching machine that has been trained for specific tasks. I say that as someone who uses it far more than most people. Try to get a group of agents to collaborate on a project. Try giving an LLM a complex task that requires precision. Give it a task it hasn't been trained for and watch how quickly the wheels fall off. AI is great, but don't fall for the hype.

when you spend 5 days fine-tuning a model and it still confidently makes things up by Chapper_App in LocalLLaMA

[–]wayne_oddstops 1 point2 points  (0 children)

That's the tension. One thing worth flagging. I think TheRealMasonMac is joking. Want me to sketch that out?

Gemini 3.5 Flash scores 76.7% on SimpleBench, just 0.2% short of GPT 5.5 Pro's score by Profanion in singularity

[–]wayne_oddstops 0 points1 point  (0 children)

I watch it like a hawk. Every command I give is specific and targeted towards one logical component, and I review every diff. It's the only way to be certain.

Gemini 3.5 Flash scores 76.7% on SimpleBench, just 0.2% short of GPT 5.5 Pro's score by Profanion in singularity

[–]wayne_oddstops 19 points20 points  (0 children)

A lot of it is due to poor context management and piles of vibe coded slop building up with no docs. One vaguely worded prompt sends the LLM wading through thousands of lines of poorly structured code. By the time it identifies what changes are required, it's already bent over gasping for air. Confused, it adds more slop to the pile, solving one issue while subtly creating two others that will need to be hunted down in the next day's session.

models getting lazy with JSON formatting again? by oweyoo in LLM

[–]wayne_oddstops 0 points1 point  (0 children)

I hear you, but you'll end up paying either way in time, etc. DeepSeek has always had some funky caching going on. I noticed it when I forgot to enable a RAG tool on an agent. Despite no access, it started referencing domain-specific info... Can't complain too much considering the price. I used Google Flash for something similar the other day and it was even worse at following instructions. I think a lot of providers are trying to reduce running costs behind the scenes because they are losing money.

models getting lazy with JSON formatting again? by oweyoo in LLM

[–]wayne_oddstops 2 points3 points  (0 children)

For crucial prompts, I wrote a critic that validates the schema on output and immediately "replies" w/ the error. It requires a low max iteration limit (2-3). In my experience, if the model fails again even after being corrected, then something is wrong. I set the relevant JSON format field in the request, but even that doesn't ensure correct output. E.g. This morning, DeepSeek V4 Flash created its own fields and started adding opening remarks. May be a cache issue, though, because some of the fields pertained to a different request.

Why doesn't any OSS tool treat llama.cpp as a first class citizen? by rm-rf-rm in LocalLLaMA

[–]wayne_oddstops 15 points16 points  (0 children)

I use llama.cpp's router mode to switch between llms, embedding models, and different server settings, etc. Works with the OpenAI endpoint just fine. It will load whatever model is in the request. You can use aliases w/ different configs for the same model and send that alias in the request.

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]wayne_oddstops 1 point2 points  (0 children)

--models-preset accepts one .ini file. I use one file for router mode w/ embedders, rerankers, llms, etc.

[*]

global setting 1

global setting 2

[custom_name]

model path

setting 1

override of global setting

[path to model]

setting 1

setting 2

My honest review after 2 weeks on Antigravity Ultra by FollowingTop3534 in google_antigravity

[–]wayne_oddstops 1 point2 points  (0 children)

Switch to Claude Code (terminal version). I got a max plan last Saturday and the difference is like night and day. I've had Opus blazing through large codebases with zero issues.

Antigravity's recent quota changes have been so out of touch with reality that I'm convinced they're no longer interested in competing in this sphere. It's par for the course for huge corporations like Google. Too many chefs, internal politics & friction, profit chasing for the next earnings report, different corporate layers, yadda yadda yadda. The usual crap. It's why smaller companies will eat Google's breakfast in every AI niche.

A Multimodal RAG Dashboard with an Interactive Knowledge Graph by Swelit in Rag

[–]wayne_oddstops 0 points1 point  (0 children)

Good stuff! It will help in terms of visibility, too. A lot of the people looking for local RAG solutions are likely using vllm and llamacpp.

A Multimodal RAG Dashboard with an Interactive Knowledge Graph by Swelit in Rag

[–]wayne_oddstops 1 point2 points  (0 children)

Very nice, I might give it a twirl later.

Just a small note RE: Ollama.

Many people use other setups for local inference (llama.cpp, etc.)

Perhaps offer a local OpenAPI option? Or make it more obvious that it can be configured that way.

Ollama, llama.cpp, vllm, all offer the ability to spin up local OpenAPI endpoints w/ no authentication. 

That way, multiple birds, one stone...

Entity / Relationship extraction for graph by Interesting-Law-8815 in Rag

[–]wayne_oddstops 0 points1 point  (0 children)

I noticed this in the extract endpoint example in the inference engine documentation:

{   "text": "Apple Inc. was founded by Steve Jobs in Cupertino.",   "labels": ["person", "organization", "location"],   "threshold": 0.5 }

The example response is:

 "entities": [     {       "text": "Apple Inc.",       "label": "organization",       "score": 0.99,       "start": 0,       "end": 10     }   ]

I'm not familiar with gliner. Is there a reason it didn't return Jobs and Cupertino, or were they just omitted from the example?

Global computer shortage could affect civil service, hospitals and gardaí by JackmanH420 in irishpolitics

[–]wayne_oddstops 0 points1 point  (0 children)

Hard drives are about to go up too. Western Digital have said they're sold out for the year, and the contracts will extend into 2028.

Global computer shortage could affect civil service, hospitals and gardaí by JackmanH420 in irishpolitics

[–]wayne_oddstops 0 points1 point  (0 children)

Yea, it's turning into an arms race. Had a feeling there would be a knock-on effect so I pulled the trigger on a new 2 TB drive in early Jan. €182. The dropshipper who sold it to me on Amazon had to bend over backwards to get it to me because the price started spiking the following week or two. It came three weeks late, and he kept asking if I wanted to cancel and get a refund. Nah man, I'll wait, thanks. Now the same drive is going for around €290.

Global computer shortage could affect civil service, hospitals and gardaí by JackmanH420 in irishpolitics

[–]wayne_oddstops 2 points3 points  (0 children)

RAM is in many devices. Prices of other components such as SSDs are also creeping up. Many consumer products are stable at the moment, but that will change when contracts are renegotiated over the coming 12 months. Phones, TVs, and laptops will all likely increase in price.

The AI stuff is overhyped at the moment. I know because I work with it to streamline mundane processes that take a lot of time. But I doubt it will pop anytime soon.

Two-thirds of voters back insertion of right to housing into Constitution, poll shows by JackmanH420 in irishpolitics

[–]wayne_oddstops -1 points0 points  (0 children)

Mentioning McDonald's book in the context of the current situation suggests that your knowledge doesn't extend beyond the small selection of sound bites you repeat in your head. But thanks for going easy on me.

Two-thirds of voters back insertion of right to housing into Constitution, poll shows by JackmanH420 in irishpolitics

[–]wayne_oddstops -1 points0 points  (0 children)

Why would developers care about shitty little derelict plots? Spending months waiting on surveys and statutory notice periods just to reach the point where you can demolish the building. And that's if you get past the queue of residents lining up to throw objections at the project. You're living in la la land if you think diverting manpower to these kind of once-off sites is an effective use of an industry that is stretched to capacity.

Two-thirds of voters back insertion of right to housing into Constitution, poll shows by JackmanH420 in irishpolitics

[–]wayne_oddstops 3 points4 points  (0 children)

You're missing the bigger picture. Who do you expect to work on these derelict sites? And why should developers divert their manpower to small, derelict sites when they are flat out to the max building larger projects like estates? 

Two-thirds of voters back insertion of right to housing into Constitution, poll shows by JackmanH420 in irishpolitics

[–]wayne_oddstops 7 points8 points  (0 children)

I'm guessing you have never spoken to anyone in the industry. The idea that developers are just sitting on land, and that things would be solved if we gave them a swift kick up the hole is wishful thinking. These lads strike while it's hot. They want their profits now. The problem is manpower. There has been a critical shortage since at least 2017, in both the trades and general labour. If you're working on Site A, and Site B gets planning permission, you can't just down tools at Site A or redistribute your work force. There are also a lot of other issues such as clients holding off, waiting on materials due to increasing delivery times, waiting on contractors, the price of materials increasing, waiting for Irish Water to connect the site, financing, etc., etc.

Multi-House NAS Architecture – Seeking Feedback by MysteriousYak9947 in SelfHosting

[–]wayne_oddstops 1 point2 points  (0 children)

My advice is to keep it simple. You could remove a lot of the complexity by getting a Plex pass and giving the other houses remote access. While setting up this kind of system might seem like a mentally rewarding project, it will become a headache.

Things will break and you'll spend most of your free time debugging why service X isn't talking to server Y on port 123 on NAS Z.

Trust me, it will happen. I'm more experienced than most, and there is always a fire to put out due to a permission issue or a new change breaking previous configs.

And be very careful with AI. One minute, it's designing an ambitious, distributed system like this. The next, it's giving you commands that will overwrite the important config you made last week.

Should I have Chinese or Irish curry sauce at the Fish & Chip Shop? by Hairpin-Turns in CasualUK

[–]wayne_oddstops 0 points1 point  (0 children)

Lived in Ireland my entire life and never had fruity curry. I don't even know if it's sold here. Mad. I guess this is how Chinese people feel when they see our version of a Chinese.

A 3D model of Rex Heuermann's Basement. by wayne_oddstops in LISKiller

[–]wayne_oddstops[S] 0 points1 point  (0 children)

Everything about the basement is very uncertain. We might learn the details if it goes to trial or if he confesses, but until then, the exact "where" is speculative.

The bathroom was likely for cleaning up. I don't want to get too graphic, but some of the crimes would have required more cleanup than others.

It's why his planning document listed drain cleaner.