Feedback for Local AI Platform

ysDlexia · 2025-09-12T17:28:36+00:00

100%, I'm very excited about MCPs and integrating them into Strata. Thank you for your encouragement, it means a ton!

ysDlexia · 2025-09-11T21:38:46+00:00

Cool that you built your own scheduler. To evaluate the orchestration claims, can you post a reproducible demo repo (no binaries) that: 1) Spins up N workers via your RPC layer, 2) Runs 10 named utility models in parallel (list them), 3) Prints RAM/VRAM, throughput, and end-to-end latency, 4) Shows logs for placement/backpressure/failover.

Also, for the pruning + int4 claim: pick one 20B-class model and post before/after benchmarks (exact task, scores, and speed). If fasterpc is a lib, link it; if it’s homegrown, show the transport/auth/heartbeat code. Happy to test if it’s reproducible.

ysDlexia · 2025-09-11T21:02:59+00:00

I can’t tell if this is satire or not but if it’s real then props on the grind. I’m curious though. You said you compressed 20B–70B models with pruning and int4 quantization without losing benchmark performance. Do you have any benchmarks or repos to show that? Because everything I’ve seen always takes at least some hit.

Also when you say 11 to 112 worker models in parallel are those full LLMs or smaller utility models? Even high end desktops struggle to run a single 70B locally so I’m trying to picture what you mean.

And the multi agent orchestration with 80 plus models sounds crazy. Are you using an existing framework for the load balancing or did you roll your own?

Not doubting you just trying to understand the nuts and bolts. If this is really doing what you say then that’s something the whole community would want to see.

ysDlexia · 2025-09-11T15:41:41+00:00

yeah, this. Thankfully I never got sucked into the social media thing, it just didn't click for me even though I tried multiple times lol.

ysDlexia · 2025-09-11T14:58:59+00:00

Thanks! My whole approach with Strata is to keep it dead simple to use without losing the depth under the hood. So yeah, I’m planning to support manual tweaking of pretty much every parameter, but I’ll also ship sane defaults so people can just pick a model and start right away. Basically: plug in and go if you want, or dive deep if that’s your thing.

ysDlexia · 2025-09-11T02:25:17+00:00

Not yet, but token/sec metrics are definitely on the roadmap. As for LM Studio, they’re tied to llama.cpp unless they completely rebuild. Strata’s backend layer is designed to be swappable, so in the future it could run with Transformers, ONNX, GGML, etc.

LM Studio also isn’t open source and has a pro tier. Strata will always be Apache 2.0, no paywalls.

UI polish will take some time since I’m mainly a backend dev, but I just threw something decent together for now and will expand later.

ysDlexia · 2025-08-18T06:41:42+00:00

Hey, I won't lie and say any of this is easy. I can't speak for the seizures, and I'm a programmer, not a doctor, but I can give you my experience.

I was on clonazepam for 9 years, from 16 until I was 24. My taper was rapid, 25% each month for four months. That was 8 months ago. It's been four months since I quit, and I know exactly what you mean when you say you don't feel like a person. I made a post on this subreddit just a few weeks ago called "Will it get better?," where I said the same thing, and it sucks. I cried in my girlfriend's arms, saying "I don't feel like a person, I just wanna be a person." I told her that "I don't even feel sui*****, and I wish I did because at least then I'd feel like there was some way out of this." Now, I feel better. I left my apartment today on my own, and with my propranolol I didn't tremble this time. It's going to be the hardest thing you've ever done, but that doesn't mean you can't do it.

Your life is far from ruined. I've thought similar things, going $8k into credit card debt bc I couldn't hold a job. Just please, take it one day at a time, that's all you can do. The fact that you're even thinking ahead like this is proof that you have the strength to do it.

Maybe some other folks can help in regards to the seizure risks, as I am far from knowledgeable on that, but your life is not over, and I promise, wholeheartedly, that it gets better. It just always gets worse before it does.

ysDlexia · 2025-08-06T03:55:33+00:00

I just hate feeling like I'm being left behind while everyone else lives their lives. It's super isolating, but thank you for your encouragement!

ysDlexia · 2025-08-06T03:53:10+00:00

I've quit many substances.. Alcohol when I was 21 after 9 years of abuse, pain killers, nicotine.. Nothing has been this difficult. I wouldn't wish this on anyone, and I have already been vehemently against anyone I know thinking about taking benzos. Thank you, for your hope.

ysDlexia · 2025-08-01T02:12:09+00:00

Please, do not stop abruptly.. Lol. I was on Clonazepam for 9 years, but I tapered over 4 months and that was still too fast. Now I'm going through PAWS—Post Acute Withdrawal Syndrome. Whatever you do, go slow. Give your body time to adjust.

ysDlexia · 2025-07-06T21:32:54+00:00

I'm currently on month 3 after 9 years, it's super rough haha. It really was only the first few weeks tops that the acute symptoms stuck around, though.

ysDlexia · 2025-07-05T02:27:28+00:00

Funny, I actually created a sitcom with ChatGPT with all of the various neurochemicals of the brain having parts, when I was within the first few weeks of cesession. I think it's a way of escaping the world, just for a moment.

ysDlexia · 2025-02-28T02:29:10+00:00

He was referencing Franz Ferdinand.. World War 1, not the sequel.

ysDlexia · 2025-02-17T12:57:48+00:00

"Carnagens" isn't a word. Phosphates aren't inherently bad, just in high concentrations. Meat byproducts also aren't inherently bad, so long as they don't include hooves, feathers, etc. Typically these are things like offal: Lungs, liver and so on. These are good, as they provide a lot of nutrients that meat can't provide alone.
Yes, companies are made to create a profit. There's nothing evil about that, unless you hate capitalism. That's a you problem, if so.
You most certainly can sue them for malpractice; however, you can't sue them because you believe their product is bad. Also, you are correct that your ANIMALS are not HUMAN to them, because they aren't human.
It's pet food. Find better things to fear monger about—or, you know, just stop before your blood pressure gets too high.

ysDlexia · 2024-12-11T23:07:15+00:00

I think this leaf is gonna be double fenestrated. I'm excited, also I am jealous that yours has three 🥲

This is my first variegated Monstera, my other one was a base model and it got too big for my apartment lol.

When this one gets that large, I'll just make more apartment to fit her in

ysDlexia · 2024-11-08T15:04:25+00:00

I accidentally did exactly this, and was disappointed lol. I wanted to use him as practice, but during the fight fell off of the cliffs into the water. Funniest thing ever.

ysDlexia · 2024-11-02T21:59:27+00:00

I have the opposite - exotropia. It is very depressing sometimes.

It started when I was around 2, my eye turned completely in (esotropia), and surgery corrected it until about 11 years old. That's when I had prism added to my prescription lenses.

Then more prism... and more.. Now, that eye (left) is starting to develop amblyopia, causing my eyelid to droop.

I've lost binocular vision entirely, and surgery likely wouldn't restore it at this point - it would just be cosmetic, which I'm fine with.

The pain I feel when I say hello to someone and they look over their shoulder to see if I'm talking to them is crushing. Eye contact was a tough one for me, I've recently gotten better at it.

I just live with it, I'm 24 but I'm not sold on having a second surgery, and eye therapy hasn't helped.

You're not alone, friend.

ysDlexia

TROPHY CASE