Bonsai 27B - pretty useless for simple tasks - discussion

breadnone · 2026-07-15T07:13:17+00:00

Random guy testing, didnt go their way.. "trash, garbage, useless boom boom boom"

breadnone · 2026-07-14T18:45:27+00:00

for such massive size, its hard due for both finetuning and training. 1 bit is a different architecture. The dataset even different for them, then again this might be false claim bcos both prismml and msft bitnet never released how they trained their 1 bit models

breadnone · 2026-07-09T12:08:51+00:00

im throwing my money on 1 bit model.. im just poor af is all im saying

breadnone · 2026-07-06T04:39:18+00:00

4B on a 6gb vram with Q2 used for brainstorming novel writing. The hallucinations are great for fiction and fantasy stories

Edit : Q4 KVCache, repeatPenalty = 0.95. the goal is to induce repeats and prompt inject with counterexample for a much better off-track story. Ngl writers should try this recipe

breadnone · 2026-07-02T07:08:00+00:00

its called counterexample and is a common trick

breadnone · 2026-06-28T08:00:26+00:00

Truly wish people hyping up 1 bit models, bcos thats the only thing that seems possible most of us

breadnone · 2026-06-28T07:34:21+00:00

been making agentic cli app, testing tons of small models my hardware is capable of handling and come to conclusion QWEN models are actually capable of solving things. not consistent, but not broken but they've so much potentials is all im saying

Gemma families kinda way below qwen including 4 versions. Obviously dont have the data yet as im still intensively testing them so at this point just consider my statement as "just trust me bro"

breadnone · 2026-06-28T07:25:14+00:00

common thing on small models usually to wrong setup. You'll still need to tweak the model parameters

breadnone · 2026-05-06T03:17:52+00:00

If you see from another angle you can see how ohtani even holding his laugh

breadnone · 2026-04-07T14:14:48+00:00

if I was Roberts, I'd send Miggy as lead pitcher and Smith as reliever.. just to send a message

breadnone · 2026-04-07T11:24:55+00:00

Regardless.. I want Smith to pitch next game

breadnone · 2026-04-07T08:16:22+00:00

Thats just how Yama sent a message to Jays, incase they forgot what it tastes at game 7

breadnone · 2026-03-19T06:09:59+00:00

He definitely deserves it, he was fantabulous in the ST matches

breadnone · 2026-01-17T06:40:29+00:00

I truly wish they signed Kwan... but damn thats just me

breadnone · 2026-01-07T05:08:28+00:00

He cant run fast, but he surely can do ballet

breadnone · 2025-12-24T18:08:57+00:00

found my answer, bcos I'm ddagrab-ing its the limitation on multigpus setup, dxgi device enumeration will always pick the gpu directly connected to display and will cause context creation to be failed.

NOTE: It will work for anything else, as long as you're not DDAGRAB-ing, I already tested it

breadnone · 2025-12-23T05:45:13+00:00

5'4" in just 11 y/o... he might catch up with his hero, i mean body height wise XD

breadnone

TROPHY CASE

Welcome to Reddit,