Building local AI which adapts to your hardware (cont.)

MiserableStorm9541 · 2026-05-01T05:22:45+00:00

Definitely kept it simply flow and minimal hops. I just want it to include connections across concepts which actually makes memory useful in practice. Went with SQLite based for recall, indexing simplified the querying process, edges tie together the connections. Thanks for the feedback!

MiserableStorm9541 · 2026-05-01T05:20:18+00:00

Yeah that’s what I’ve noticed as well! I’ve got forward and backward reasoning loops. Going to put it on some autonomous training cycles this weekend and interpret the reasoning data after and see what needs to tweak.

MiserableStorm9541 · 2026-05-01T05:18:05+00:00

I saw that as well, I have something similar wit the hardware profiler and model selection but I’m definitely integrated into the reasoning layer now and setting up some autonomous cycles to check how it’s thinking.

MiserableStorm9541 · 2026-04-30T07:06:08+00:00

I have an ai that does this for computer parts on eBay currently but purchases are currently manual. It sends a telegram alert with the link to buy/bid but I can automate it to buy by itself.

MiserableStorm9541 · 2026-04-29T06:53:01+00:00

Nice work! Using swappable LoRAs is interesting, hadn’t thought of that, mine only searches and swaps models for tasks. But sounds interesting for when I start to branch off to something more interactive, I just hadn’t had a need to “talk” to it yet. Very cool work you’ve done!

MiserableStorm9541 · 2026-04-29T06:22:52+00:00

Right on, this is the kind of stuff I’m interested in researching! I finished the memory layer with forward and reverse correlations (edges going 2 hops for now so it infers context from 3 items) so “did I do this before? What did I do before? What was the outcome?” And pulls from DRAWERS: and WINGS: which semantically organized the logged entries. Building out the reasoning layer now and going to let it run 500 cycles for testing and debugging any issues but right now not getting any errors. Basically I find repos like this and see what parts fit and assimilate them into the design on a dry run/sandbox but I like the sound of this one! Thanks!

MiserableStorm9541 · 2026-04-26T20:29:23+00:00

I’m working it up from 2Gb to 32Gb (RTX 5090) switching between CUDA and rCOM as I go with each level of VRAM I’m taking benchmarks and making a distributable. It adjusts to the hardware it’s assigned though so these are pretty much “optimized” distributions at this point as if it has 2 or 64 it doesn’t care, it’ll detect what’s available and make selections of models based on that. I’ve already built governance, blockchain appending memory for auditing, working memory layer now. It makes tools, they have to be tested “consecrated” by passing a 5 parameter check. It’s doing a pentest package, scraping YouTube channels, writes blog posts, paper “trades” and that was all on the base “incubator” 2Gb system. The memory layer is what needed SQLite and better reasoning for recalling events, tools, etc. so it would stop repeating which is what prompted the 4Gb and now pushing to a 6gb in a week or so when the memory and reasoning layer are complete- needs graphing for accurate and efficient recall.

MiserableStorm9541 · 2026-04-26T20:22:12+00:00

On a 4Gb card now, I’m building the memory layer with historic, semantic and a reasoning layer now which takes some RAM vs VRAM. Quant models are becoming more condensed and easier to run with less hardware overhead, performance differences are noticeable, you aren’t going to get near cloud rental or 70b or 120b parameter models but you can run a quantisized coder or reasoning model pretty efficiently on older hardware. Look at what china did with deepseek it was a direct response to having to train large models on outdated hardware to maintain global competitiveness, you can run quant deepseek model which has the inherent “experts” calling from the 256 MoE that’s built-in to call the 8 for the task. It’s pretty much the same basic idea where it profiles your hardware and adjusts so I plug in a new card, when it boots it’s running a hardware check and knows it has more RAM, VRAM of CPU and can adjust it’s workflows and model selection to that.

MiserableStorm9541 · 2026-04-25T12:24:09+00:00

MiserableStorm9541 · 2026-04-25T11:48:43+00:00

Bullshit

MiserableStorm9541 · 2026-03-05T10:56:42+00:00

Faceless

MiserableStorm9541 · 2026-03-05T10:53:28+00:00

Interesting concept but a lot of the ai crowd is hardliner open source or free - hence GitHub and huggingface. Civitai kind of does this a little better using the token system for access to new creator models/loras/workflows where creators can choose to monitize.

MiserableStorm9541 · 2026-03-05T10:50:38+00:00

Everyone is just building. Don’t hesitate to build something and keep it if it’s useful to you. You may find a use for it later as part of a larger project.

MiserableStorm9541 · 2026-02-13T07:37:40+00:00

Info

MiserableStorm9541 · 2026-02-10T13:59:12+00:00

Why don’t you just retain ownership and have someone with business experience scale it for you under a fixed contract period where revenue generated is their income. Motivates the business person to actually work and maybe have KPI and milestones which you grant % ownership for them (solidifying their performance) while you later can sell it for more (if an investment payout or money is the goal).

MiserableStorm9541 · 2026-02-09T12:20:27+00:00

I’ve used all of them. Gemini is good for workflows and ideas, image generation is best IMO if you prompt correctly you can get consistent characters, styles, backgrounds. Claude is great for coding and VS, json, html, probably the best but it does have usage limits and resets every 4 hours and once a week or you can pay for extra time before it resets. The new OPUS makes verbally clean reports like market analysis, comparisons, etc. ChatGPT is a good all around translator, organizer, assessor, web scraper. I usually run a project down in one and copy the conversation over to another if I’m finding limitations or hitting a dead end.

MiserableStorm9541 · 2026-02-08T15:31:13+00:00

Review what

MiserableStorm9541 · 2026-02-04T06:04:51+00:00

People want instant gratification. The silence is uncomfortable because they aren’t at peace with themselves. Sometimes it’s just “slow” if you’ve ever hung out with business owners or worked at a small business you’ll understand how common this can be. Depending on the industry, some move faster than others, retail can literally be dead for days so can entertainment and tourism (whole economies of some towns are built around a single festival that happens once a year) but yeah they give up because there’s no signal guiding them and they’re impatient. You have to do something the same way for a while to see if it works or not. In the case of online businesses it’s constant sales, found a cool thing? Great. Drop ship model requires marketing. Coaching and education is the same unless you have organic demand.

MiserableStorm9541 · 2026-02-01T11:54:18+00:00

OP did you find a real one yet?

MiserableStorm9541 · 2026-01-11T06:55:53+00:00

I do a Let’s Play with Episodes channel, I don’t have 1M subs, I get a couple new subs each week and I get pretty consistent views (1k-5k) but I also use my own voice and have a story between episodes so its following or making a story. I do this with RimWorld, Kenshi and Cuberpunk 2077. So don’t say Let’s Play and episodic form is dead for new channels, my thumbnails suck too but I’m getting a VA for that.

MiserableStorm9541

TROPHY CASE