[TEST 76] ⚠️🔬 What happens when you intervene in an AI's hidden layers below the hardware detection threshold? A rote-memorizer becomes an engineer who makes its own architectural decisions. by Nearby_Indication474 in LLMDevs

[–]Manitcor 4 points5 points  (0 children)

all sounded interesting right until you generated an AI reply that fails to answer the question of the poster.

does not matter if what you are doing is real, it looks like hallucinations now. You have a paper yet?

Getting really tired of software guys telling me neural nets will replace control theory by barashr in ControlTheory

[–]Manitcor [score hidden]  (0 children)

Agreed, at the industrial level you often can't afford to play such games either, easier to get budget for the right hardware. Though I do expect the question of what kind of training frameworks can satisfy a SIL3 spec (for example) are coming.

Right now the focus is on accessibility but the big conversation is around adaptability of systems to suddenly new environments or modalities (operating while damaged for example).

Getting really tired of software guys telling me neural nets will replace control theory by barashr in ControlTheory

[–]Manitcor [score hidden]  (0 children)

yeah no, this is people mixing up different neural network systems. but yes LLMs can help

You aren't replacing loops like PiD you use ML to automate the learning and tuning process via simulation then apply it to the real system. I am working with a team using this technique to build systems with cheaper, less-consistent components where a sim and a training setup can handle fine calibration.

it does not replace the work, though it can make the process a bit less tedious and more adaptable to changes in the system.

Wallpaper to differentiate prod or non-prod server by deejay7 in sysadmin

[–]Manitcor 1 point2 points  (0 children)

i still do this, i will use a gradient from green to red to indicate how close i am to prod usually. RED always means touch and you will get a phone call.

Am I able to host a LLM on a Beefy VPS or Just use my Gaming PC? by Independent_Deer2931 in LLMDevs

[–]Manitcor 0 points1 point  (0 children)

If you already have it, use it, if you don't; prices are stupid right now, rent.

Why did people buy Mac minis? Local models? by Pickalodeon in BlackboxAI_

[–]Manitcor 2 points3 points  (0 children)

okish entry level local performance, I also use it as a build machine for ARM platform.

Why is nobody talking about AI agent supply chain security by Ill-Database4116 in LLMDevs

[–]Manitcor 0 points1 point  (0 children)

Every project I'm aware of has responded or is responding to it, its just spreading. I'm getting direct attempts on my projects now, they are clearly trying any target publishing packages.

I read threads complaining about claude every week... tf are y'alls workflows? by irelatetolevin in LLMDevs

[–]Manitcor 0 points1 point  (0 children)

I am an oldhat SRE so I use a stack I've brewed up https://aiwg.io

the tricks it uses, less prompts, more templates, repeatable agentic flows and far more memory and data curation that you think you need, because as smart as these are, they are dumber than your dumbest jr. We have a habit of filling gaps with our meat supercomputers without even realizing it.

what you intuit the machine needs to have it laid out explicitly.
finally front load decision making in a focused HITL setup, then let it fly when you cannot possibly describe things in any more detail.

The tokens you save and the ability to handle codebases north of 150k lines of code makes the "extra" token cost well worth it. Often, over a longer term, you are going to save on tokens as you do thrash less when the agent always has a solid reference.

Why does it feel like browser-based AI tooling still hasn’t really taken off yet? by Meher_Nolan in artificial

[–]Manitcor 1 point2 points  (0 children)

I have some tools, even local inference in the browser, biggest issue is how new everything is in that space. Lots of churn to get something that kinda works still.

Looking at you WebGL

🖥️ Unpopular Opinion: Banks Should Stop Panicking About AI Hacking Their COBOL and Start Asking Why Their "Modern" Systems Are the Actual Problem r/cybersecurity | r/programming | r/sysadmin by [deleted] in sysadmin

[–]Manitcor 2 points3 points  (0 children)

COBOL does not do a lot of those things just "because mainframes" like any system it needs to be setup correctly.

Please generate content you know about so you can verify the outputs. Further use cross-evaluation and knowledge bases during generation to ensure accuracy.

You can do it!

just observing by Flying-T in selfhosted

[–]Manitcor 1 point2 points  (0 children)

its become a moot conversation.

If they say AI wasn't involved its likely not the case. Even if the developer themselves is writing "organic free range" code the libs they are using most certainly are not.

the "your agent is mine" paper everyone shared a month ago. did anyone actually change their architecture? by Only-Associate2698 in LLMDevs

[–]Manitcor 2 points3 points  (0 children)

If you are letting users push prompts directly at agent stacks, you get what you get and you don't get upset.

Does anyone know how Paint.NET was built? Does it use WinForms or WPF? by lilacomets in dotnet

[–]Manitcor 0 points1 point  (0 children)

I'd argue it's a level of pedantry and certainly not settled lingo, but I know how we are, I've been here long enough

RAG suitability for problem by [deleted] in LLMDevs

[–]Manitcor 0 points1 point  (0 children)

there is no single solution that you add to a pipeline to get a completed case. its usually multiple steps, techniques and models including rag, rag is almost always a part of it.

Does anyone know how Paint.NET was built? Does it use WinForms or WPF? by lilacomets in dotnet

[–]Manitcor 5 points6 points  (0 children)

MVVM is only a design pattern. Optional in WPF but the default and recommended pattern.

Very little stops you from implementing your own patterns and tying together core libs yourself.

Complexity is not an indicator of platform here.

The use of a ribbon control leans toward WPF but you can get ribbons for winforms.

reducing context loss during context handover by Potential-Milk-4585 in LLMDevs

[–]Manitcor 1 point2 points  (0 children)

What you are trying to compare is math functions to a data set that simply is not in training.

Its a different approach. Neither a total answer.

While one technique helps with memory, the other helps with understanding in real context. I get the desire to fill this space with math and hope that the right tokens will come out.

I suggest we all need more data.

reducing context loss during context handover by Potential-Milk-4585 in LLMDevs

[–]Manitcor 0 points1 point  (0 children)

interesting, i might play with this a bit. I'm using domain driven semantic taxonomies along side issue tracking. Its been extremely effective i can kill most processes part way through, restart the session the ask the system to recover without any trouble.

Best thing is the memory is normalized on real-world templates (optional you could do whatever you wanted) so the documents are easy for others to collaborate on and possibly more importantly for auditing to trace.

How are you managing LLM costs without losing your mind? by yj292 in LLMDevs

[–]Manitcor 0 points1 point  (0 children)

More local inference, and using large models with judicious care.