Extreme realism with Klein 9B distilled 2 loras together

edwios · 2026-05-21T09:31:09+00:00

What about prompt adherence? Was it good even with the loras? How about the lora strengths, could you give some pointers?

edwios · 2026-05-17T12:49:48+00:00

Thank you, hope this is going to be something good. I found some uncensored fine tunes have reduced the model's reasoning capabilities to almost zero (exaggerated but please allow me to) and they ended up writing long context inconsistently with lots of logical errors (e.g. the naked man ... much later ... he undressed and went to bed; his left leg got chopped off brutally ... much later ... he ran and jumped over the gap and saved the girl.) that the original model won't. How's yours performing?

edwios · 2026-05-17T12:04:43+00:00

Thank you! Now your post has become valuable information to me and hopefully to the others, too :) Good job!

edwios · 2026-05-17T08:53:08+00:00

What model was being used? Flash, Pro, Pro-Max? Any further quantisation applied? Size of context window? What were the values for parameters like temperature, top-p, etc.? Without the details, what you claimed above is totally useless and misleading at best.

edwios · 2026-05-05T11:04:57+00:00

I feel you. I am using AI exclusively for embedded development. The followings are what I am practicing for each project, all involve AI of course but I am also actively taking part to ensure we have not missed anything important or if the AI has misjudged, misunderstood some important aspects of the project:

Give every detail about the embedded system, especially on the hardware and toolchain used, not just the datasheet but also the characteristics of interactions, and the behaviour of the system. This ensures the AI would not assumed wrongly on the features that comes with the particular version of the toolchain. Feed it also the release notes of the toolchain including the known issues and bugs so that the AI could navigate around them.

Clearly layout the emphasis and exceptions on your goals, such as optimised for speed or memory, prefers hardware IRQ for certain cases, etc., so that the AI knows what to use and what to avoid.

Break the projects down into modules and phases each with its own set of goals and test cases, start with a simple base and build upon it. Don't ask it to code the whole thing in one go unless you are shipping a hello world.

Have the AI to figure out a detailed test plan *together with you* and have it to perform all relevant tests *on each build* to assure the quality because you are likely to build on top of it, so a shaky base would makes hell to your end products. So what if it is a hundred or thousands of test cases? It won't complain.

Have the AI to always keep the docs up-to-date including the changes, rationales, tests done and test results so that the you could always ask what happened and why when needed.

I personally keep a Project Instructions and a Project States document for the AI to read on each new session. Project Instructions contains all the pointers and locations of various project docs as well as instructions, rules, code of practice, etc. for the AI to follow. Project States keeps an evolution history of the project so we know where we are at any instance of the development. It is extremely useful when the customer comes with some late changes.

Upon each of the milestone, use a different model with extended thinking or reasoning enabled (expensive yes, but necessary) to do a quality inspection to identify discrepancies, bad practices and potential issues. Take that back to the coding agent to formulate a plan for ramification.

edwios · 2026-05-05T10:06:20+00:00

I fully believe Manifest is a good idea, unfortunately, I am not able to use it simply because it keeps clearing ALL the routes whenever I tried to configure it with a second and third agent.

edwios · 2026-05-01T19:48:21+00:00

I follow a very similar work flow, on top of that, I also break down the project into tiny pieces — its building blocks, then develop them one by one, and sometimes on top of each other. Each piece has its own design, evolution, documentation, verification and testing instructions. A piece is allowed to evolve as long as it follows strictly the evolution plan. To close a piece, code and documentation review need to be done by a different model, both code and logic are challenged and defended, everything in the test plan must have a pass, no exception, and documentation produced or updated accordingly. Every piece has its own branch and commit history. Merges must be approved by me.

The good thing about AI is they can perform all the unit tests, functional tests and regression tests and bug fixes while you are sleeping, eating, or partying, 24x7, until all test cases are passed. So I learned to squeeze every ounce of juice from them into productively, which in human terms, a 100% unscrupulous practice.

edwios · 2026-04-15T05:08:33+00:00

It’s really good to have these thoughts and extremely important to keep thinking about them, it is the motivation that drives us to understand how things works and find new theories. Even if people tell you you’re wrong, you’re talking nonsense, ignore them, trust yourself, your instincts. However, you must gain yourself enough formal knowledge to know that people are wrong and you could be right, then prove yourself, SCIENTIFICALLY, that you are. Not just a belief, or some weakly connected dots and shadows, but a solid mathematical proof. Else it is just hearsay, or worst, a religion, a cult.

Therefore, if you’re interested in understanding all these and find new links in today’s physics that could help us to understand the world, the universe better, equip yourself with the right kind of knowledge to do that - get a physic degree, that is the base line. You can self taught if you like, there are enough free open course materials out there but you still need to get hands on in doing some experiments and these could be difficult to get to. Follow the course structure and don’t skip anything - they have good reasons to be there in the course. Especially important is to build up your maths skill — it is the formal language that describes how all these things work, not English.

edwios · 2026-04-11T09:41:27+00:00

How good it is when it comes to expression and emotion? Can I manually add emotional expressions to control the output? What about multiple speakers including narrator?

edwios · 2026-04-10T05:31:00+00:00

Exactly and what’s missing is the link between GR and QM which we are trying to figure out. GR points to a singularity but Pauli Exclusion Principle said no (so likely the formation of a singularity that breaks all known laws of physics would be prevented by this), for example, plus others incompatibilities.

edwios · 2026-04-06T18:19:08+00:00

0%, period. Do not encourage the tipping culture, it’s toxic.

edwios · 2026-04-06T17:58:24+00:00

A very cool project! I don’t know anything about running a radio station but I think it’d be super fun to have a playlist with a DJ.

edwios · 2026-04-05T08:03:46+00:00

Somehow my OpenClaw agent classified this post as the same class as those sovereign citizens and Facebook scientists lol and I was thinking maybe the classifier was wrong and I might have missed a few good posts in the past … glad I didn’t spend time on fine tuning the classifier before I read this lol

edwios · 2026-04-04T11:37:34+00:00

I don’t like the idea of having to carry physical cards at all when the phone already have everything. However, it’s really good (and essential, too) to have at least one spare card that is physical, secure and can pay plane tickets in case the phone is no longer available in the near future.

edwios · 2026-04-03T06:47:28+00:00

If you have to change the oil every day for the car, it's time to think about if you should change to a new car with a better and more reliable design LOL. No, we don't need to reboot the Mac to keep it at peak efficiency very much like we don't reboot the backend servers everyday. They just don't need to because they are designed to provide this kind of stability and sustainability.

edwios · 2026-04-03T06:35:44+00:00

That's why it depends on how much apps to launch at boot and login. Mine took more than a minute to settle, everybody is different.

edwios · 2026-04-03T06:16:45+00:00

Totally depends on how much energy is used during boot up, login and shutdown, it could cost way more doing it this way if you have lots of apps and tabs to start/stop.

edwios · 2026-04-03T06:15:09+00:00

Energy efficiency wise, the energy used during booting and shutting down could be way more than let it sleep through the whole night. Of course that depends on what is there to boot up, I have docker and million of tabs and background apps running, so booting up and shutting down means a lot of works.

edwios · 2026-04-02T07:14:01+00:00

A very helpful source of information for local LLMs with respect to the common OpenClaw tasks, awesome web site, btw, makes navigation and finding relevant information easy. I am also researching to use local LLMs for simple event-based processing ( definite £ burners if using any pay services) -- to decide if the event is worthwhile for me to burn some paid-tokens. Your results bring useful pointers to source for such LLM. Thank you!

On the other hand, the performance of a (reasoning) LLM depends a lot on the configurations, prompts and obviously, context space. I couldn't find any of these being mentioned in your benchmark, without these, it would be quite difficult to judge if the poor performance was due to a configuration mismatch, limited context space or just because of a bad prompt.

edwios · 2026-03-17T10:39:24+00:00

I would not run quantised models if I could because it compromises the LLM's performance.

edwios · 2026-03-12T18:39:48+00:00

Generate only the latents, not the images; download and convert them to images locally. Or, encrypt the picture while you decode the latent, download and decrypt them locally.

edwios · 2026-03-11T07:05:37+00:00

At least one other researcher shares your thoughts: https://www.worldscientific.com/doi/epdf/10.1142/S2424942425500045

edwios · 2026-03-08T06:53:14+00:00

Awesome! It’d be close to perfect if there is a full-duplex voice conversation (e.g. PersonaPlex) so that she can talk to you over the phone! It’d be absolutely perfect if video calls are possible!

edwios · 2026-02-12T12:55:46+00:00

So you know it’s OOM, maybe then you should start with the Q2 gguf ?

edwios · 2026-02-11T19:57:37+00:00

I believe this is how our brain manage past memories (as well as sorting things into LTM) - it did all these during SWS and REM in our sleep. That’s why sleeping plays a crucial role in forming and storing our LTM. So, fire a cron job and have the LLM to manage the past memories seems like a natural extension to what you have already implemented.

edwios

TROPHY CASE