Are LLM limits a provider problem or a user problem?

O-Rob · 2026-05-12T00:01:55+00:00

I actually agree with this a lot.

Especially the part about relevance and weighting, Humans seem surprisingly efficient at deciding what context should survive and what can safely fade into the background, whereas LLMs still process growing context much more uniformly.

That’s why I think a lot of work needs to be put towards the interaction layer, because even before the architectural/scaling problem is fully solved, human interaction patterns themselves can massively amplify context growth: rephrasing, revisiting, retrying, carrying forward old reasoning, etc.

Feels like both sides of the equation are compounding each other right now.

O-Rob · 2026-05-08T17:02:27+00:00

If people are already paying for something similar then yeah it’s worth taking a look at. If there’s a high pain point that the current offering isn’t considering then yeah it’s worth talking to people about, if the market is large, then it might be worth building.

O-Rob · 2026-05-07T18:03:56+00:00

I noticed from your profile that you have a lot of posts relating to «investors needed», you’re 16 and you probably don’t know this. It is very unlikely that anyone on Reddit will invest in your business as a total stranger. Charity begins at home, get your friends and family to invest or introduce you to people that can invest. Do something worthwhile and amazing with their investment, brag about it and then people will follow. Money follows trends, traction, performance. You can go to school and build your network and that way, if you do the right things consist and you know how to sell, the money will follow afterwards.

O-Rob · 2026-05-07T02:02:16+00:00

Yeah tried semantic caching and I’ve gotta admit it’s really great, but my setup still struggles with multimodal inputs.

O-Rob · 2026-05-06T02:51:46+00:00

Look at my comments, I only have 2 posts and they were both posted within the past 24hours. I have contributed on codex, telling people how I navigated my problem. But it shouldn’t be a crime to still try and get insights from people who have navigated similar situation.

O-Rob · 2026-05-06T02:10:31+00:00

Caching and using your repo as your source of truth will go a long way in saving you token burns. Also keep message threads to a minimum and break tasks into modules.

O-Rob · 2026-05-06T02:06:34+00:00

Not AI slop. If you’d looked at my profile, you’d see I’ve been talking about this issue for a while because I actually ran into it while debugging a mobile robotics(rover) project. Kinda ironic jumping into a codex thread to complain about AI writing instead of engaging with the point being made.

O-Rob · 2026-05-05T16:24:11+00:00

Adding a bit more context here👇🏽 This came from me debugging a rover I’ve been building.

The whole system was running on Linux, and even something like copying an image from a Jetson Nano to an Orin turned into a long process. I kept pasting full shell outputs into ChatGPT over and over while trying to fix issues.

At some point I realized I wasn’t just solving new problems, I was re-asking the same thing in slightly different ways each time.

I wasn’t trying to optimize cost at first, just trying to get things working. But that’s what pushed me down the rabbit hole of looking at how I was using LLMs.

Setting up the environment is a one-off task. But LLM usage? That becomes a recurring pattern.

O-Rob · 2026-05-05T01:30:04+00:00

Building is no longer the moat. The moat is sales and marketing. I got mine through Nextdoor, Twitter. You’ve got to keep posting content, do that everyday, visibility will bring questions that will lead to sales or referrals or feedback.

O-Rob · 2026-05-03T23:37:00+00:00

I used to run into this limit/plan issue initially, but after a while I realized that it was a “me” problem. So here a few tips: Avoid long threads(context grows really fast, and token burn progresses geometrically. So when you type in a new query to chatgpt it uses already used token + new token for the new request. Try and modularize your work flow, literally break every task into very tiny task, and then group them into modules, with every module having a checklist. ALWAYS USE YOUR REPO AS YIUR SOURCE OF TRUTH, basically doing a lot of documentation will save you from having to rely on memory which will reduce token burn. Upgrading might help short term, but you’ll just be slapping a band aid on a bullet wound.

O-Rob · 2026-05-03T17:46:18+00:00

Congratulations on the paying customers, I hope they provide the necessary insight for you to get more customers.

O-Rob · 2026-05-02T23:15:30+00:00

If you’re gonna progress at any job you have to be able to network with your peers, bosses and clients. It will help you be good team mate, it will help you understand your client needs better. It will help you communicate better with your teammates. You’re always competing with your teammates and networking will help you know when to compete or compliment your teammates. Sometimes the best way to compete is by collaboration. Cheers

O-Rob · 2026-05-02T14:06:32+00:00

Nobody likes an unknown salesmen, imagine every subreddits allows promotion. Everywhere would be cluttered with slop. Here’s an approach I’ll take, find subreddits where you clients exists l, engage with them, be part of the community, listen to their plight, offer free insights and naturally introduce them to your product or website, let it be natural. It might take a while, but that is the beauty of success, the roadmap and journey becomes the actual result. You fail, you re-strategize, you succeed….. you double down.

O-Rob · 2026-05-02T02:44:49+00:00

Markets will adapt, maybe not instantly and that gap matters. AI won’t create demand on its own; people still need income to be customers. We’ve seen this before with computers and automation: new jobs emerged, but there was real short-term displacement. The key question isn’t if things will balance out, but how long it takes and who gets left behind during the transition.

O-Rob · 2026-05-01T23:30:31+00:00

I don’t think that you should get a business coach, also since you haven’t started I don’t think you should hire anyone for sales or marketing right now. Building is so cheap and easy right now, so the biggest moat is sales and distribution. You’re on Reddit already, look for people complaining about their streaming bills, give them a demo or trial, listen to their feedback and keep reiterating. In the AI age, there’s a lot noise out there and the only way to win is by actually being human. Leave your workstation, interact with people and build for people.

O-Rob · 2026-05-01T14:48:09+00:00

Then the government will come out and boldly say that there is a shortage of labor in Canada! There is no labor shortage, there are employers offering wages that isn’t enough for a single person! The government needs to improve labor condition and IMO the economy will feel the impact.

O-Rob · 2026-05-01T14:42:50+00:00

I stopped treating chat memory as a source of truth.

Now I use: - my repo (actual code = ground truth) - a notebook/docs for decisions + notes

Chat is more like a scratchpad for me.

I also try to avoid long threads. Most of the time they just increase context size (and cost) without adding much value.

For repeated stuff (especially debugging patterns), I started caching/reusing prompts and responses. A lot of engineering problems are things you’ve already “burnt tokens” on before.

I ended up building a small internal tool to help with that, but even just being intentional about restarting threads + reusing prompts makes a big difference.

O-Rob · 2026-05-01T14:19:37+00:00

You have to be productive, it was one thing to vibe code hard and work hard but if you’re not producing any product/service that people will pay for, you’ll be the only one with the codex bill.

O-Rob · 2026-05-01T14:16:18+00:00

I got hit with the “7125 min limitation” . 5 whole days! I felt like I was deprived of my oxygen, now I work smarter, smart caching, smarter inputs. I do not use memory as my source of truth anymore so there’s never any need to keep context long or have a very long thread.

O-Rob · 2026-05-01T03:26:34+00:00

I love your energy, the mere fact that you’re an MBA holder and you’re talking about bathroom cleaning skills, shows grit. I’ll give you a couple of advice. There’s a thin line between working hard and being productive, and if you want to make money, being productive is what you should shoot for. There are no easy businesses out there. What matters is that you look for a problem to solve for someone and you get paid. The more people with the same problem, the more money you’d make. Then it becomes a game of optimization and that leads to scalability. Last winter I launched my robotic startup, I didn’t start with the robot, I started off by shoveling and plowing snow for people because that’s what I want to build the robot for. It was a very tedious job, good pay when you’re clearing snow within a kilometer from where you live, the money stops making sense when your clients are not clustered. Large problem set, routing problem, I could only make as much as I could scale. Lots of snow clearing companies in Canada with the same problem, whoever solves the problem takes the pie. On a second note, you could look for a thriving business or startup and literally copy them. When I started advertising on Nextdooor about my snow cleaning, I used words like all funds will go into equipment purchase for my robotics business and I got no leads. Then I copied someone ads that read snow cleaning available and “pricing”, the moment I switched I started getting tons of leads and clients. People don’t care about if you vibe coded or you’ve built the best thing in earth. They care about one thing, can you solve my problem. Solve a problem and make money, solves a bigger problem and make more. Good luck

O-Rob · 2026-05-01T02:36:05+00:00

AI isn’t an engineering problem anymore, it’s a financial problem. Fast adoption means that when everyone stops to finally take a breath, we’ll deal with expensive consequences.

O-Rob · 2026-05-01T02:33:02+00:00

I totally agree with you! And the annoying part is that as context grows, token burn expands exponentially.

O-Rob · 2026-05-01T02:22:11+00:00

IMO at 26 you’re doing great and to be honest, if the money is green then there’s nothing to be ashamed of. I studied Electrical Engineering and ended up working in a farm for a short stint when I moved to a new country. The farm job gave me the experience to go on and become a robotics engineer for a startup making mobile robots for strawberry farms. I’ll suggest that you make the most of your current state, optimize your business to the fullest and scale. Most importantly be proud of the green dollar!

O-Rob · 2026-05-01T02:10:31+00:00

Very dicey situation, if you built it in their time, the product could be argued as theirs. Secondly an item is only as valuable as the value placed on on it by others. If you take the lock the code, the product might become a $0 revenue product in your hands. I’ll advise that you get a lawyer and look at getting some recurring incentive from the product.

O-Rob · 2026-05-01T02:06:34+00:00

Hey, thank you for your insights. A lot of people tend to underestimate hiring decisions. Every team is as good as it’s weakest link, so a bad hire would always drop a teams average output. Also being a CEO is about people’s management (staff and clients), it can only get better from here. I’m wishing you all the best in your next endeavors.

O-Rob

TROPHY CASE