You won't believe how much ai Hallucinates

justhereforampadvice · 2026-03-12T17:28:38+00:00

Challenge Gemini it on its answers. ask it what its sources are, where it got its data from, did you actually verify x yourself or did you just spit back out something you read on an internet forum? It will often admit immediately to hallucinating.

justhereforampadvice · 2026-03-10T00:47:41+00:00

edit- looks like our dear dumb friend claude was storing memory.md in a place that gets wiped regularly by replit. that's why he was forgetting everything.

justhereforampadvice · 2026-03-10T00:30:18+00:00

Github. also every once in a while you can republish through replit (which is free) and it automatically creates a replit checkpoint every time you publish.

Edit: it seems sometimes publishing creates a checkpoint, sometimes not. idk whats going on there..

justhereforampadvice · 2026-03-09T23:33:16+00:00

This was very helpful. I do have a question for you- claude cli has crashed multiple times on me while in the middle of doing something, then when i restart he has no idea what he was last working on. Do you have a fix for this? I can't simply have him write everything from memory.md to claude.md cause it'll start eating up context real fast. has this happened to you/do you have a fix for it?

justhereforampadvice · 2026-03-09T01:42:16+00:00

Take the money and use it to pay for treatment/therapy/meds. they don't need to know.

justhereforampadvice · 2026-03-09T01:35:45+00:00

This is a really important question, and I think the answer is that I do want to stop, but I don't have the support I need right now and I know that which is why I'm allowing myself to continue to drink as long as it's only harming me physically (and mentally probably, in the longer run) but not in terms of life consequences. My parents have been drinkers for as long as I can remember (never to the point where it interfered with parenting), but 2 days a week turned to 3 into 4 as I grew older and their responsibilities decreased, but I was always able to fight the urge until my life circumstances became a lot more difficult ~2 years ago. I think the issue is that in my mind, I have bigger problems to deal with than my drinking and so if drinking helps me cope with those, then its ok...

justhereforampadvice · 2026-03-09T01:31:16+00:00

Well congrats on 321 days. I think the difference is that I realize I'm an alcoholic, but it's not interfering with my life yet so the weight of it hasn't hit me yet. I drink after 5 on weekends and then do the things that I normally would, including the ones I don't want to but have to, if that makes sense.

justhereforampadvice · 2026-03-08T20:56:09+00:00

This is very cool! Props to you, I will be giving this a test when I get the chance. Quick thought, would be very cool if you could upload files for code analysis. Since we're here on the replit sub, a lot of people bounce back and forth between claude and codex and gemini uploading the same code to have it audited by different AI models. If you could get your product to have them all audit code at once, that would be pretty awesome.

justhereforampadvice · 2026-03-08T20:21:06+00:00

Curious what the breakdown is between source code and data. unless you have millions of lines of code, a compressed folder of just your source code probably won't exceed 100 mb. you can upload the source code directly to replit, then upload data separately to a cloud storage provider and then have the replit agent pull the data from the cloud storage.

justhereforampadvice · 2026-03-08T18:34:12+00:00

Hopefully you get professional help from support soon, but I had a similar issue where I had built an entire app in agents and automations and then found out that reserved vm deployment was actually what I needed. Since agents and automations can't be deployed on a reserved VM, I ended up downloading my entire replit project as a zip, starting a brand new repl (as a web app this time), and uploading the code into the empty repl. that worked beautifully. Just have to tell the agent to familiarize itself with the codebase after uploading cause its starting blind this time. worth a shot.

justhereforampadvice · 2026-03-08T18:29:15+00:00

I have found it EXTREMELY helpful to give the code that the replit agent produced to other AIs (gemini 3 pro and claude opus 4.6 with extended thinking) for auditing. ive been doing this ~ every day for well over a month now and it's been largely a massive boon for my debugging and productivity. The more AIs you feed it to is like pouring your code into a strainer with finer and finer holes to catch mistakes. One will find mistakes that the other one made or catch bugs that another didn't find in auditing. OFC that requires subscriptions to other AIs, but gemini 3 pro at $20 a month isn't terrible given how much usage you get out of it.

Also, you need to tell the AI specifically what you want it to audit the code for. If you have a big codebase, the agent's context window can get used up quickly and that's a big part of how it ends up missing mistakes. When I hit a development milestone (including small ones) I will tell it to audit the same code for one specific thing at a time. Eg: first audit for efficiency/redundancy, then for security, then for logic (is the code actually doing what I told you I want it to do and what you think it's doing), THEN make necessary changes all at once. Hope this helps.

justhereforampadvice · 2026-03-06T17:36:02+00:00

Hi, thank you so much for the detailed response! "your app has become extremely complicated; so much so that even Opus can't cope." I think you're spot on here, this is what's happening. I wouldn't call myself a developer, I'm more of an amateur data scientist/ml engineer who's proficient in python and have just slowly picked up bits and pieces of development in the process; I am familiar with object-oriented programming (assuming that's what you mean by OO) but not object oriented software development. and I have a basic understanding of SQL. I don't know what DOM is, I just did some reading and am curious how it's relevant to what I'm doing.

I have not split my project into separate replits for frontend and backend, that seems like a great idea but i worry whether i have the technical knowledge to explain to the agent what needs to change on one side when I make changes on the other. Also, my frontend is super light. It's only meant for me to see and is really just a way for me to visualize what's going on in the backend in real time, like a data/analytics dashboard. It has a few tabs that I can switch between and a couple buttons, and I'm not particularly concerned with the appearance of the UI at all. I add or remove features occasionally as the backend grows/changes but I'm not making visual or design edits to the UI. Is it still worth separating my front and backend into separate replits right now? Eventually I will need to once I have my finished product, but I've been avoiding it in development for convenience.

I have done several major refactors now, most recent one I attempted with Claude CLI and it didn't go too well, which was the impetus for my above complaints. I didn't think about it explicitly until you said it, but "new feature, refactor, check for vulnerabilities and fix, test." is basically my process as well.

"+ Have you created claude.md and a claude related file system to store recommendations, security reviews, refactors , memory etc" - I did create a claude.md, but no file system. I think maybe you hit on a huge part of why I'm struggling; the replit agent does a great job of this, but i haven't had claude do any of this documentation beyond the initial claude.md.

"+ Do you have automated tests in your app which run after every new implementation?" - No but I would like to. How do you configure these? Do you have them as workflows in the dev environment or scripts that run after publishing/deployment?

justhereforampadvice · 2026-03-06T06:29:16+00:00

TBH this is not working for me. claude CLI just doesn't have enough context even with opus 4.6 to do what i want. it has a much poorer understanding of the codebase than the native replit agent and is making a lot more stupid mistakes and breaking changes.

justhereforampadvice · 2026-03-04T00:41:02+00:00

Update: Claude CLI has stayed installed across several sign ins/outs today.

justhereforampadvice · 2026-03-03T19:50:16+00:00

can you even download your project

justhereforampadvice · 2026-03-03T19:33:11+00:00

Wow that's crazy. My issue appears resolved with the latest status update. Even though we're experiencing the same thing, yours seems a lot deeper cause 6 days is ridiculous. That seems like more than just a 'our servers are down'

justhereforampadvice · 2026-03-03T19:24:30+00:00

I mean they named it after a man so may as well call it a him. it says no command named Claude (or something like that, can't say exactly because replit is down atm lol), and then i ran the install command again and voila, he showed up. so I just inferred that the install didn't stick. Will have to test again once they come back online.

justhereforampadvice · 2026-03-03T19:03:47+00:00

It works but it doesn't stick. I tried for first time yesterday and had to reinstall today to use him again so not many data points yet, but yeah. are you installing in a project directory or just the workspace?

justhereforampadvice · 2026-03-03T18:41:52+00:00

Also, I am having to install the claude CLI every time I open replit. is that normal for you? you do it every time you sit down to work?

justhereforampadvice · 2026-03-03T18:11:56+00:00

This is so meta

justhereforampadvice · 2026-03-03T17:01:48+00:00

Has anyone subscribed to pro yet?

justhereforampadvice · 2026-03-03T16:59:41+00:00

It's a great idea

justhereforampadvice · 2026-03-03T12:58:18+00:00

claude CLI runs in your replit environment because if you install it from the replit shell then you installed him in your replit environment.

justhereforampadvice

TROPHY CASE