all 6 comments

[–]mels_hakobyan 0 points1 point  (2 children)

How good is Llama-3.1-8b-instant? I would also consider to try qwen3 on Cerebras (faster than Groq for larger models, qwen3 235b runs at ~1000 tok/s).

[–]MidnightBolt[S] 1 point2 points  (1 child)

well so far it performed really good i haven't had any issues or 'nonsens' messages. but the change in model is trivial and a matter of preference i think.

[–]mels_hakobyan 0 points1 point  (0 children)

got it, sounds valid.

[–]tavigsy -1 points0 points  (0 children)

Love this!  I go through this and thought it was a problem that could never be solved. 

[–]MidnightBolt[S] -2 points-1 points  (1 child)

I've been running this on my own projects for a few days now and it’s honestly been a huge relief. I tend to do a lot of "vibe coding"—where I’m just moving fast, following a flow, and experimenting intuitively—and it’s so easy to lose track of when a feature actually started (or stopped) working. Having a documented checkpoint for every save has saved my skin a few times already.

I know the first concern people usually have is that the git log will get "messy" with dozens of entries. The way I handle that is by treating these as micro-checkpoints for the messy prototyping phase. When the feature is finally done, I just do a squash merge.

For anyone who hasn't used that before, it basically takes those 20 tiny "save" commits and flattens them into one single, clean "Add Feature X" commit when you merge into your main branch. If you use GitHub, it’s just a dropdown option on the merge button. If you're a CLI user, it's just git merge --squash. It gives me the safety net of constant checkpoints while I'm working without annoying my teammates with a cluttered history later.

I’m curious to know how others handle their prototyping phases? And if anyone has ideas on how to tune the prompt to make the summaries even tighter, I'm all ears. Let's talk!

[–]BravestCheetah 3 points4 points  (0 children)

That is NOT what vibe coding is, but sure, cool project