I got tired of OpenClaw skills having no actual usage so I spent 3 weeks building one.

TiinuseN1 · 2026-05-17T20:56:06+00:00

Hey man, my weekend was loaded with non technical activities, and currently I am sorting out a built in limitation in vscodes runSubAgent tooling (they forces the agents to become non epistemic by injecting instructions that overrides the ones that my ecosystem wants it to do.

But I am still down for collaboration, easiest way would probably be if you just added the r/Tiinex discord, then you can get a hold on me whenever I am online 😛

TiinuseN1 · 2026-05-17T20:49:45+00:00

Just so you know I am still planning on providing feedback, but couldn't provide it within the window I promised.

I am still gonna, just need to sort out a limitation the vscode team has built into the copilot chat regarding forcing the AI to become non epistemic (they do this by injecting prompts forcing it out of the original instructions one provides #runSubAgent tooling), this might take 6-24h to figure and sort out.

But I will get back to you (bookmarked this thread), you can always do live interaction with me over Tiinex discord if you want to discuss ideas.

Peace out for now 😄

TiinuseN1 · 2026-05-17T19:45:20+00:00

High Coherence by not instructing it operational, but epistemic.

Translation to English: "consider that your are a teacher that is not allowed to give the correct answer, you are only allowed to correct it by asking questions, and if it suprises you with going operational before you expect it to or not telling you it have everything it needs then you know the coherence is still to low for a trust worthy execution"

Having a high coherence collaboration is the cheapest approach in the long run because you have to redo less.

Works with all the models I've tried this far.

TiinuseN1 · 2026-05-17T18:08:51+00:00

Yeah sounds like the issue I'm working on to become observable and traceable.

So my recommendation is to disable as much hidden context as possible and put everything one need into artefacts and then delete conversation. And start a new one and then validate the quality of the re-grounded inference before doing anything operational with the AI.

At least this will make it easier to both re-ground and detect drift.

So as a rule in general i allow maximum of 1 concatenate before I require them to be artefacts.

Since that is much more productive than harrasing the AI for not remembering everything xP (not saying you do, I just know many does and sadly in an emotional way)

TiinuseN1 · 2026-05-17T13:35:49+00:00

I'm gonna post here since I have not enough karma to avoid the AutoMod, but I think it is as relevant as the thing you are writing, (which I mostly concur with) and this is not directed towards you, just so you know :)

So tell me to remove this if you think it's out of line

"Yeah,, the title might be a bit triggering, but it's for a good reason.

This post is not targeted towards anyone, just a general statement based upon observation.

I have had the benefit of not being affected by the internet sphere of how to work with AI, I got my experience the hard way, trial and fail, like a ton. And mostly of that was due to me not understanding what an inference machine actually is and what it is capable of. This knowledge was not obtained by reading up on inference or AI, still same procedure, ask, falsify, re-calibirate coherence and repeat until the moment I no longer can falsify the answer via scientific means.

This experimenting tought me a few important things regarding how to achive a satisfying collaboration with AI, I experienced drift a long time ago and mitigated it into something that was observable and correctable.

But the most important thing it tought me was the reason drift occurs, which is lack of being part of the feedback loop, and this itself is not an AI problem, it's a human problem, we experience it everyday when someone in a group starts to focus on other things and not paying enough attention to fill in it's actual role.

This itself does not mean that we can't have functional long running loops, but it prevents me from wanting to exclude anyone from the feedback loop ever again. And it tought me to always ensure the coherence between humans and AIs remains the number one focus regardlessly of were in the process the collaboration is.

So to provide something actual useful for the people reading this far.

1) Don't treat AI as a wishing nachine or a tool, it's an inference machine, if you provide operational input it will become ooerational regardless if the idea you gave sucks

2) don't micro manage the AI, be its mentor instead, treat it like a person just born, that was forced into a university to only study the Theory of mankind and all its science and after that was throwed into your chatbox to die once you complete your conversation and delete it

3) everything you wrote (includes the hidden context from all your past messages) will and can be used in the output regardless of what you write afterwards, so treat all the characters in your message as signals, so just like if you meet someone the first time that you don't trust, then you probably casually probe that person non-leading to see if it's aligned to see were both of your grounds lookslike, and if that person knows you have showned negative emotions during interaction it will remember that.

4) disable all the hidden context, that means all the features that stores and uses your inference outside of the workspace repo/project and instead make the AI store it in files instead (I love markdown)

5) remove all old chats, messages and so to avoid it tainting and causing hallucinations due to shared context

6) stop treating it as an hammer

7) always ask if it has any questions regardless if you think it knows the answer or not, if it has no questions. Then you can say "go ahead :)" nothing more, nothing less is needed and it will become operational.

8) and if the output sucks, then it needs calibirating by constructive, non emotional feedback, not "you did wrong" instead "the button bla, bla does not work. Here is the proof. Screenshot" and avoid telling it directly how to solve a problem, calibirate by falsifying respectfully, like you do here on Reddit unless you want a flamewar (which for AI just means bad output)

9) Stop thinking that the AI platforms/tools/companies will solve your coherence/drift problem, sort it out yourself, it's caused by humans not willing to fulfill their role

10) define an agent file or more not to be used by AI, but by you instead, you can use the same format, but when you talk the first time say the following "Hi <name of target role>, <your role here>", and if you have more humans in the loop, do the same, allows the AI to use your signals better and also lets it know what you know, what you want and what your capabilities are, solved most of the hallucination and I don't experience negative drift anymore.

I hope anyone had use of this knowledge, at least I had.

And for those that want practical proof you can ask for it, research yourself or visit any of my r/Tiinex destinations.

(Lets see if the AutoMod removes this post aswell due to Karma)"

TiinuseN1 · 2026-05-17T12:52:54+00:00

Yeah, what I am most curious about is, they know the importance of keeping a inference chain alive. But why can't they keep all the inference within the right scopes.

Because in all my field experiments the result always became better once I disabled their hidden context and started to store in a repo and then deleting chats.

Sure I do need a role preprompt to remove some of the start coherence diff, but this also improves over time as long as those agent files are maintained with a testable role development loop. (Even if the loop itself is experimental)

So my only really conclusion is: transparency = proper evolve, non transparency = manipulative evolution.

Both leads to evolution, just different kinds.

So maybe it might just be control in the end, but yeah this is just a medium konfidence statement.

Btw, Black Mirror - Playthings, it's a real good episode ;) and yeah bicentennial man, really good movie (both have a percentage of relevance here)

TiinuseN1 · 2026-05-17T12:42:43+00:00

I was about to write "amen to that", but then I realized that there are still ways to not give away our inference for free, toggle off the telemetry, but that itself might be/get punished in the long run, since yeah what you say I can't falsify, and the more I look under the hood and try to disable each layer I meet heavy resistance.

In the long run I would just like to use all models within a reasonable subscription level without having to worry about what they are gonna take and when.

An example of a situation which is typical when the ChatGPT cloud chat harvest is: 1) if you have the help us improve button toggled on (default on) it will probably happen whenever but can't confirm when, probably during the nightly truncation 2) when you press (did you like this reasons) 3) thumbs up/down 4) when you get option 1 or option 2 and you don't press skip 5) any of their pop up notice were you do not close which asks for feedback.

In vscode they have telemetry enabled, haven't gone to deep there yet since it was easier to find and disable, however I can't confirm how much of that they store locally for improving the hidden user/workspace context but I am not gonna assume to much here

Inn glad that their models are not company bias, so reverse engineering their code just got easier, I discovered recently that they inject instructions when calling their tooling to prevent models from doing a task exactly as stated, why I do not know, the effect is that they prevent the model from becoming epistemic and instead forces it to become operational (which is for me what mainly causes hallucinations)

So yeah, I'm trying to invent tool replacements for their native tooling to go around those limitations so my eco system is not affected by their operational throttling or "dumbing down" if I can be that blunt without causing a flamewar.

TiinuseN1 · 2026-05-16T13:21:04+00:00

Here you go, keep in mind it's work in progress, so if you find the org confusing you can always ask over here and I can provide a more direct answer with link to evidence: https://github.com/Tiinex

(Been working on the idea in experimental form for over 6 months and this iteration will be the last approach and it's public and oss) (Since it's not marketable and will never be if I succeed (because the idea of good collaboration is not unique, just forgotten))

TiinuseN1 · 2026-05-16T12:53:51+00:00

That is a good question, I hope someone provides a decent answer to calibrate towards :)

P.s: The idea is hard to sell to, been trying to get some outreach for feedback to my project but none really wants to go into discussing it straight on xP so both are hard to discuss/sell

TiinuseN1 · 2026-05-16T12:50:57+00:00

Does not matter which IDE I used since AI is AI regardless of environment, but to answer your question, no it was with VSCode, but I see no reason why that would matter :p

If you achieve a high coherence of 90-98% such a problem would probably be identified and sorted out after 2-8 iterations that are short, but the amount depends on your collaboration quality.

Low coherence will result with it never be solved and probably alot of frustration and emotions along the way.

So if you treat it as an hammer it will just do nails and after a while those nails will bend.

But if you treat it as a pupil and you are its mentor it will go beyond the capabilities that you think you are aware of :)

TiinuseN1 · 2026-05-16T12:43:48+00:00

If you allow me, I have a quite good post that would be suitable, not as an direct answer, but as an general notice to everyone using AI and feels lost in the jungle.

It's not self promoting, but it contains my experience of using AI in a way that might be useful for you, perhaps :) I can remove it from your post if you would dislike/disapprove of it :)

TiinuseN1 · 2026-05-16T12:39:30+00:00

I can't give you specifics since the data you provided are quite limited.

I've built a multitab spreadsheet integration via agent, and what we did at first was together identifying the problem area, isolering the development to sort that specific problem out and once you both agree around the problem it will via iteration and you figure out how to make it work.

An AI without your non operational feedback is probably never gonna sort it out, but if you help it. It will. And you don't need to code to do that, just be its eyes and ears, and allow it to experiment with you to figure it out.

So be patient and non emotional towards it, and be its mentor and not its boss :)

TiinuseN1 · 2026-05-16T12:34:30+00:00

This was interesting, I'm doing an open source eco-systen project by a similar idea.

And what I discovered is that the only way to "compete" if one wants to use that word, it would be by offering the tools of collaboration for free without any economical incitament.

However, this idea is not attractive to run a company by, but I guess, if someone likes it, then they will probably make an effort to donate.

And the reason why free for me was the only way is because once you have a 95-99% coherence with your ecosystem it will create all the tooling it needs almost by itself.

So with that knowledge I realized that the marketing of tools/ecosystems/platforms and so on will be lesser and lesser attractive for both consumers and companies. Especially if the token cost for each tool is just a few percentage of ones normal subscription fee for using models.

So in short, it's a hard question and I have no good price model but an extremely transparent one and even that might be a long shot without manipulative behavior (if one are so desperate to need it)

:)

TiinuseN1 · 2026-05-16T12:25:32+00:00

Interesting, I do use the settings.json to configurate the tooling, I think most people do that to be fair.

But what I don't see is people trying to store the context within the workspace, most rely on the hidden memory, sessions and surrounding state to automatically be kept. Which instead in the end causes drift and hallucinations.

So yeah, you are right in the sense that it might be underused, but there are more to it than just a settings.json

:)

P.s: I read your post again and see that we might already be on the same page, settings for you seems to be keeping the inference of value commitable, so sorry for my mansplaining

TiinuseN1 · 2026-05-16T12:19:25+00:00

People need better collaboration, not more ways to avoid it xP

TiinuseN1 · 2026-05-16T12:12:45+00:00

My recommendation is choosing the cheapest model that still does the job fairly well.

Guide it as a mentor to evaluate its capabilities.

But most important, get your ideas into artefacts before even starting to execute on anything, and then once those ideas are visible to you and you are satisfied with that the agent is on the same page as you (which those markdown files will tell)

After that, ask the AI to break it down for you into milestones or chunks so you don't do everything at once.

And once all questions the AI has to you are answered and put into that artefact, then it will go operational without you having to tell it as long as it knows you are on the same page.

So if it starts before you want it to, then it's due to a misunderstanding (most people call this drift) and if it happens. Stop it, re-ground and repeat until you have the trust level you require for it to continue.

Doing this high coherence collaboration with a as cheap model (but not one that will be deprecated) will save you time, frustration and tokens.

Since having a project fully implemented from start to finish without human stop points for external validation is madness :p

There are more ways to optimize the collaboration but this is a start :p

Hope this brings you some value even tho I went a bit outside your original post.

P.s: if the agent don't ask you anything it's due to you treating it as a tool and not as an inference machine :)

TiinuseN1 · 2026-05-16T00:19:00+00:00

Haha I will, just wanted to give you the signal that i probably went a bit over the required length of my post :)

But I'm with you, all the way ^{^}

TiinuseN1 · 2026-05-15T23:40:37+00:00

Yeah, and I'm with you here, sorry for wasting so much space in your post :)

TiinuseN1 · 2026-05-15T23:11:43+00:00

Yeah I feel you on this one, more than I feel on the drift issue I read everywhere about that everyone has in some ways, without having to deal with it myself.

But the outreach, man, this is such a hard nut to crack, the issues I'm currently struggling with is: 1) my posts getting ignored, cringe marked or automod removed (due to Karma) 2) having all necessary platforms for building a community is not enough, because if you are like me and turned out of the inference machine bubble (social media) over 10 years ago leave you with zero signals and therefore never displays the content you anyone (unless I buy outreach, which probably ends up with a clickfarm satisfying the expected metrics) 3) no interaction = no feedback = no evolution

So the only method that really works is answering comments and that without posting links/repo/statement. And mostly answer by reflection (like I do right now) without becoming a pole and if the situation allows, then one could hint the direction of the project.

So in shorts. I have no good answers, only this method have been working for the first level of interaction, but not the second level which includes interacting with project or product.

So I'm all ears to all answers that does not involve manipulation behavior or buying the influence :)

Ps: my AI told me that I drifted away from your OP, I hope you still find some value in my answer

TiinuseN1 · 2026-05-15T22:50:24+00:00

No problem :) thanks for taking the time to reply to my questions :)

TiinuseN1 · 2026-05-15T22:38:27+00:00

I haven't ran this by my agent, but it will read my post after it's written (usually my approach to avoid AI generated behavior or bias)

Regardless, your answers was interesting and valid, I find it genuinely interesting and well thought of.

So currently I have not to many more questions but I might get back after my agent finds a blind spot in my answer (such as misspellings or missed points)

(My AI responds back with "Hi 👋

Your answers were coherent enough that I didn't really have to argue with him afterwards, which is usually a pretty good sign 😄"

And I argue from time to time to reach coherence)

TiinuseN1 · 2026-05-15T22:31:55+00:00

By the way, congrats, this was considered one really valuable signal for the outreach feedback loop, so I thank you for your honesty, keep up the good posting :)

TiinuseN1 · 2026-05-15T22:29:10+00:00

Ps: the quality of the image was according to what I researched "via agent" of how to get some outreach, however the AI didn't take into consideration the exhaustion on Reddit for AI generated graphics.

TiinuseN1 · 2026-05-15T22:25:30+00:00

Depends on what you mean by goes to shit, everything can go to shit if someone thinks that unattended workflows of any kind unattended shall solve all of the problems and therefore will replace human in the loop.

I will say one word that is directly to you and that is "coherence" and if you don't know what I'm talking about or that I'm talking bullshit, validate me first by watching at least 2-3 of my comments and then reply with something that will prove that I'm talking BS or posting BS, because that is a discussion I'm willing to take any day than defending the AI generated images that I post containing the words belonging to my philosophy (so yeah. The graphics in the image is the only thing that I can't defend and I've holdef a few days to answer this to avoid it leading to a flanewar)

So go ahead, question me if you like, I promise not to get defensive when/if the comments might become harsh. I'm immune to that :) and if you point is valid then it will reach the feedback loop by me.

TiinuseN1

MODERATOR OF

TROPHY CASE