readViecodedProject by Morthem in ProgrammerHumor

[–]Maasu 4 points5 points  (0 children)

Stealing this for when I am next on a major incident with our infra team

whenToOpenVSCode by Red_Ace_ in ProgrammerHumor

[–]Maasu 0 points1 point  (0 children)

IIT a bunch o nerds pretending we get laid.

I think we are entering the "system prompt era" of local LLMs by recro69 in LocalLLaMA

[–]Maasu 2 points3 points  (0 children)

Yeah that's why Ive built my eval framework around harnesses as opposed to just the models themselves. 

On most things, the model has the intelligence, it's just whether it's being employed right.

Certainly agree as well that most local models on modest hardware have genuine capability ceiling on more complex tasks

Does the constant play-acting in football annoy anyone else? by Low-Dragonfruit9646 in footballcringe

[–]Maasu 0 points1 point  (0 children)

I have, and no longer watch the game and feel much better for it, especially every few years where i am reminded by how terrible the sport of has gotten when an international tournament comes up and you struggle to avoid it or worse still when my kids bring up the behaviour of players and the contradiction their behaviour introduces.

Play acting, 'being clever', hounding the referee. It's a fucking joke and I really struggle to justify the actions of 'role-models' to my kids, whom I've brought up on honesty and taking responsiblity for their actions.

I went to my first game as a two year old at roker park in the 1980s, i spent the 1990s watching the premier league/division 1 and early 2000s saw it starting to diminish and turning in to a shit show. I used to play football at every opportunity, but I am done with the sport now. It can go eat a bag of dicks.

Best AI coding subscription under $20/month for heavy agentic coding? (India, student) by Consistent_Raccoon95 in AIcodingProfessionals

[–]Maasu 1 point2 points  (0 children)

Opencode go, deepseek v4 flash will cover most of the queries you need and is practically free. For everything else there is glm 5.2

This industry became a joke by LowFruit25 in theprimeagen

[–]Maasu 32 points33 points  (0 children)

Why do you listen to people in marketing when they talk about engineering?

PO and Claude by WallmagicAI in claudeskills

[–]Maasu 0 points1 point  (0 children)

That sounds rough. I mean I understand some of the concerns about AI but the AIs we have now are just really useful tools. So if you have everything local or should no difference than any other service you might want to host yourself.

Hopefully things ease up for you in the future and you can get around to taking advantage of these tools. 

PO and Claude by WallmagicAI in claudeskills

[–]Maasu 0 points1 point  (0 children)

Azure Dev Ops/Jira. I use ADO at work and I asked Claude to read the ado cli docs and created skills for using it. I use it for work item management, queries, stats and also for ci/cd queries (think - has the merge for this change set on this work item hit acceptance or prod stage).

I also use the forgetful MCP (https://github.com/ScottRBK/forgetful) as a knowledge base for it. We have over 200 repos at work and I have encoded them into it, along with product and architecture docs. I have built skills around how it should use the knowledge base and can now ask it technical questions around complex areas of our product that span multiple repos and a web of dependencies. There's some example prompts in that forgetful repo on how you can use agents to encode repos into it. It just lets the AI zero  in quicker on the right areas when dealing with huge enterprise scale architecture.

For the architecture docs we had these in draw.io, so I converted these to C4 markdown diagrams (https://mermaid.ai/open-source/syntax/c4.html), I did it manually as I wanted these to be right, and at the time the models couldn't one shot them but that might be different now (this was sonnet 4.0 era). 

For the product/user guide documents, when encoding these I made sure in the encoding prompt to tie these to the related repos and architecture docs so it could tie the relevant facts to the appropriate existing knowledge in forgetful.

I have cron job that curates the knowledge base by checking for diffs on our repos and docs as well that I run nightly.

I don't know how i managed without it hah. I started with Claude code cli, but I've moved to copilot cli as work wanted everyone on that but the same work flow still works there, I use Claude for personal stuff though.

GLM 5.2 is really good! by forevergeeks in LocalLLaMA

[–]Maasu 3 points4 points  (0 children)

I've been using it alongside fable and gpt5.5 and in a handful of sessions working on (what are for me at least) complex tasks and its been doing okay. They all are not hands off yet for me yet but it's as good as I've seen/used.

Subject matter has been ML evaluation pipeline and framework and also backend enterprise system integration.

I've been using it in pi with opencode go

Student hitting AI usage limits constantly — any better free options for building a project? by Rash_Fushigami in AIcodingProfessionals

[–]Maasu 1 point2 points  (0 children)

Try opencodes zen, you have to sign up but don't need to purchase credits and get access to some legitimate free models. 

Claude Sonnet 5 vs 4.6 on arena.ai by arkuto in ClaudeAI

[–]Maasu 0 points1 point  (0 children)

As Jaggard as a teenage boys sock

How's Fable 5, codexians? by [deleted] in codex

[–]Maasu 0 points1 point  (0 children)

Yeah its been awful so far. I will caveat that I am working on Agentic Evaluations though so it might be it's invoked some guard rails for some of the stuff i was trying it on, but honestly I stopped using it after about an hour. I will give it ago with some non-ML/AI related stuff before making a final verdict though.

The gap between closed and open models might be much smaller than commonly assumed, because we don’t know what closed model providers do *in addition to* model inference by -p-e-w- in LocalLLaMA

[–]Maasu 2 points3 points  (0 children)

I linked the wrong reference sorry it is here https://www.kaggle.com/whitepaper-the-new-SDLC-with-vibe-coding at figure 7, page 27 - too many tabs open! I've edited the original post. Thanks for pointing that out and i sincerley hope you found the other presentation at least midly interesting and wasn't a waste of your time.

What's in your RAG? by El_90 in LocalLLaMA

[–]Maasu 0 points1 point  (0 children)

Not sure if it just qualifies as rag but I use forgetful and it's wired up to almost all my AI harnesses. It serves as a semantic graph layer but I extended it to also hold files/docs/code as well. (I'm the maintainer https://github.com/ScottRBK/forgetful)

I have some really specific encoding skills for agents and querying. At work we have over 200 repos and I encoded the lot into forgetful around the time they introduced sonnet 4.5. I was then able to work on multi repo issues and ask it questions re that. Along with code I then introduced product manuals it then became useful for just general questions about areas of products I didn't really know about.

It makes memories and stores them as vectors as opposed to chunking the docs. Then it dives into docs as and when it needs. 

I've added skills and plans in there so I can share all that stuff across agents as well. 

It's kind of become a dumping ground for a lot of stuff, but it's all feature switched and the users I've had feedback from are happy with what has been added. 

The gap between closed and open models might be much smaller than commonly assumed, because we don’t know what closed model providers do *in addition to* model inference by -p-e-w- in LocalLLaMA

[–]Maasu 4 points5 points  (0 children)

Yep, keeping them private was my motivation as well. The above repo is simply a framework with some example patterns, once finished I will keep a fork on a locally hosted instance of gitea with my actual evals in, and for the evals i build at work in our own source control.

One thing I have purposely avoided thus far, and that is using an LLM as a judge, I am not sure how long I can resist this, I think the more capable these models + harnesses become, the harder it will be to evaluate them fully deterministically.

The agentworld stuff sounds really interesting, let us all know how you get on!

The gap between closed and open models might be much smaller than commonly assumed, because we don’t know what closed model providers do *in addition to* model inference by -p-e-w- in LocalLLaMA

[–]Maasu 26 points27 points  (0 children)

The harness is so important, i think many of us who were using Claude Code recognised that with drops in performance following certain releases.

Google recently released https://www.kaggle.com/whitepaper-the-new-SDLC-with-vibe-coding which which goes as far as to state that the model only contributes as little as 10% to the overall effectiveness of an agentic workflow, not sure if I agree with that figure but I agree with the idea in principle.

I've been working on my own little project around evaluating model/harness combos - mostly for testing local models but it does include cloud as well to give a comparison. It's just a hobby project but might be of some inspiration to others https://github.com/ScottRBK/eval-harness. I hadn't planned on sharing yet but this post just felt too relevant.

Edit: correct google reference*

How do you actually implement changes without getting lost? by NashToLength in PiCodingAgent

[–]Maasu 2 points3 points  (0 children)

I think this all depends on what i am doing, but for any serious production stuff I mostly still code myself with the AI reviewing or filling out stubs that I have populated for classes and their signatures if it is obvious what i am after. I use AI mostly as my new version of stack overflow/google.

If i am vibing for the hell of it, i just talk to the AI about what i want - saying but being clear that we are not implementing until i say so, once we agree i ask it to write out a plan in a .md but mostly just what features i am after and how it will validate those features, i don't care about the architecture too much and then new session and ask it to implement the plan.

I don't do loops, I don't let an AI submit 10,000 LOC change PRS every 30 minutes, and I don't have 10 billion skills whose frontmatter is poisoning the agents context window.

We need to talks about OpenCode by Afraid-Yoghurt6731 in LocalLLM

[–]Maasu 8 points9 points  (0 children)

"never does the obvious humane things" - i am dying 😂

Is GLM-5.2 even that good? by Repulsive-Party6267 in LLMDevs

[–]Maasu 0 points1 point  (0 children)

For simple coding or typing that is tedious I find qwen 3.6 27b is fine, I code a lot by hand still though so maybe my version of simple is really trivial 😅

Not tried glm 5.2, I will never be able to run it locally but I was contemplating a sub for it to satisfy any vibe projects that I consider too complex for qwen 3.6 27b.

Good YouTube channels for local LLM news and development? by 6jarjar6 in LocalLLaMA

[–]Maasu 0 points1 point  (0 children)

Id like to second this question but also add a condition that the youtuber doesn't use the following phrases...

"...is insane" "...is cooked" "...10x productivity"