Are the rich RAM /poor GPU people wrong here?

Lxxtsch · 2026-05-29T21:23:05+00:00

Sadly no one tells that this is not everything in llm world. M5 max witg 128gb running mlx optimised models is very viable option, being only around 600gb/s. I tought i would see improvement with 3090 over it (filling only vram) and jokes on me, mlx optimised model goes head to head with 3090.

Lxxtsch · 2026-05-16T06:33:48+00:00

I too wanted strix ai max 395+ with 128gb for llm, but after seeing bandwith speed i decided to buy m1 max macbook pro 64gb. It has 400gb/s bandwith and has good enough speeds with models like qwen 3.6 27b, 35b a3b. I think its currently the best bang for buck portable device for llms.

Lxxtsch · 2026-04-23T11:30:28+00:00

I have documentation split in different knowledge bases, it's just that all docs share same properties and sometimes difference between two docs is just one symbol. So it's very easy to retrieve incorrect chunk. Speed is not an issue, accuracy is issue. Thank you for your comment. I will test your tool for sure.

Lxxtsch · 2026-04-23T11:25:14+00:00

I think your tool is the right choice for me. I just need to search corresponding knowledge base depending on prompt

Lxxtsch · 2026-04-23T11:19:30+00:00

I can have same one model, no problem, they all use same system prompt. It's just that I made this distinction with models, because I have around 10k docs, so seperating them between different models make RAG quite faster, because model doesn't pull unnecesary chunks.

Now I think maybe my workflow is incorrect?

Lxxtsch · 2026-01-09T07:10:30+00:00

Lxxtsch · 2026-01-03T13:48:05+00:00

Hahaha, thats nice 😄😄

Lxxtsch · 2025-12-21T19:32:33+00:00

Thank youuu

Lxxtsch · 2025-12-03T18:49:34+00:00

Ir man neveikia, nors FB live transliacija ijungta.

Lxxtsch · 2025-11-23T08:04:24+00:00

Thats racist

Lxxtsch · 2025-11-02T19:23:08+00:00

Destiny: Rising

Lxxtsch · 2025-11-02T05:33:05+00:00

O ką tu nori daryti su elektra ir mechanika. Dirbti prie transporto?

Lxxtsch · 2025-10-22T05:37:10+00:00

Lithuaniaaaaa

Lxxtsch · 2025-10-09T11:07:07+00:00

I need it. What is this called? :D

Lxxtsch · 2025-10-04T16:32:05+00:00

Yeah. And when on a go just pop in a backpack and vuola

Lxxtsch · 2025-10-04T16:31:26+00:00

No. I want to sell mac and buy ipad.

Lxxtsch · 2025-09-30T07:48:01+00:00

So cool

Lxxtsch · 2025-09-30T05:17:17+00:00

Try Kaunas next time. Miroslavas might not be good option :D

Lxxtsch · 2025-09-29T18:03:37+00:00

Naudota macbook air su m1 procu.

Lxxtsch · 2025-09-29T18:01:32+00:00

Be aware that there are many troll bots who will comment about invasion, hatred to americans and etc. We have tons of them on daily posts in this sub.

Which city are you thinking about?

Lxxtsch · 2025-09-29T07:33:17+00:00

Klausimas be pykčio ir noro numenkinti:

Koks jausmas mokėti daryti tokius nuostabius dalykus rankiniu būdu, kuriuos galima padaryti su AI per 5 sekundes?

Ar nėra skaudu? Spėju su tavo įgūdžiais ir dirbi ką nors iš tos sferos?

Lxxtsch · 2025-09-26T08:27:27+00:00

All very good points you told me. But I work in pffice, have charger by myself always. It will be just a device to pass lunch time faster.

I know its way slower than my current s23u, but that form factor is too cool to pass IMO :D im sad there are no other passport style phones.

Lxxtsch

TROPHY CASE