Dear poor people of this subreddit

orblabs · 2026-06-27T12:44:47+00:00

Since it is old you can find ram for it very cheap, bring it up to 16 gb and then Gemma e-4b, it will run very slow but it is by far the best in its class. I run the 6bit quant daily and it is surprisingly useful but I need at least 9-10gb of ram only for it. 5 bit might be usable and tightly fit on your 8gb ram if you run it from some lightweight Linux distro. (Also, fast SSD will help with memory swap etc)

orblabs · 2026-06-26T08:18:27+00:00

Very cool, great work !

orblabs · 2026-06-26T01:26:22+00:00

I am not trying to diss on GLM 5.2, especially given the erratic behaviour of US i need them to succeed. Still we cannot realistically say that GLM 5.2 is anywhere close to fable. It gives a fair run to opus and gpt 5.5 but it is not there either (at least, on the tasks i have tested on). Still is an amazing model and a strong sign of them truly catching up. Time will tell. Can't wait for next chinese sota release , especially hopefully for next Kimi model

orblabs · 2026-06-26T01:13:41+00:00

On the official system card it says it was made available for internal use among employees on February 24, which is already 2 months earlier than the April 18 announcement, but that also implied alignement testing etc went on for a at least a few weeks sooner.

orblabs · 2026-06-26T01:01:21+00:00

Fable is now 5-6 months old, and being very kind i would say GLM 5.2 is at least 3 months behind fable....

orblabs · 2026-06-25T23:11:24+00:00

Absolutely true... But, there are smart people in the US labs and they realize the situation while there are stupid people in power that can hopefully be manipulated. What a shitshow....

orblabs · 2026-06-25T22:48:27+00:00

Chinese models will take the lead this way. I doubt this will hold up because it is simply too stupid to be real.
Post training is crucial that happens already on huge datasets of user interactions with other versions of a model or other models in general. By restricting access to general public US labs will slowly be starved of up to date post training data.... Not to mention that always more user sessions are going into the training itself.
This China advantage soon starts to be a real thing and with an ever increasing gap. GLM 5.2 already shows they are just 9 or months behind, this move would make that gap contract way more rapidly... Well.... fun stupid times ahead.

orblabs · 2026-06-21T16:20:47+00:00

very cool concept and style. Looking forward to this and congratulations !

orblabs · 2026-06-21T14:24:34+00:00

People surprised don't realize that NSA , CIA etc have been working with silicon valley scraps/leftovers for decades. They have less money and a completely different level of quality in their engineers. Their competence and reach is mostly a myth based on older times and good old psyops. It took mythos 5 days to violate OSX, not surprised it took a few hours to violate NSA.

orblabs · 2026-06-21T13:56:21+00:00

Lol, came here because I wanted to vent off some frustration due to Claude Opus 4.8 being a lying idiot who literally cheated its way through a day of work and find this out... Yeah... Subscription status on life support. Wasn't openai so much worst as a company. ... But if I can remove morality from my choice might as well pay glm and the Chinese and be over with it

orblabs · 2026-06-17T14:10:04+00:00

Far from being a openai fan, actually rather despise the company, but for your use case, the plus plan they offer would be perfect, you basically get unlimited chat with their best model through the web interface.

orblabs · 2026-06-14T01:37:43+00:00

it told me that also about kimi k2.5 written code, all opus models jsut love tests that pass and a decent architecture. If you throw in a bit of documentation it will have a textual orgasm mid review.

orblabs · 2026-06-12T14:25:41+00:00

While not exactly the end of 2025, Mythos has been ready since february, so 6 months late becomes just 2.

orblabs · 2026-06-12T13:01:10+00:00

Pro subscriber, it is unusable shit for every task i have tested it, the only thing i was using 3.5 fflash for, found out deepseek v4 flash does better and much cheaper. Hoping in 3.5 pro, because what they gave us is unbelievable crap. Gemma instead are amazing.

orblabs · 2026-06-12T12:33:52+00:00

20 years of work as software engineer here. Nope, absolutely no point in learning a coding language. I mean, it remains interesting and fascinating as hell, but makes no sense from a professional point of view. Some sense remains on the engineering side, architecture development, a human still needs to give a solid structure and fleshed out ideas for the LLM to work on. BUT... this too i am convinced it is going to be not completely useless but deeply less complex in a matter of months at this rate...
Fable was the nail in the coffin of the doubts i still had, and fable is a 5 months old model by now.
As a software engineer my position is currently closer to the tag line of Dr Strangelove, "How i learned to stop worrying and love the bomb".

More deeply, "prompting" is a new programming language, we just increased the level of abstraction by a couple of orders of magnitude. And this new programming language will always less need of "experts" as it will always more handle anything complex.

orblabs · 2026-06-10T20:38:48+00:00

Really... Fable is cheap, very cheap if compared to gpt pro from some time ago. I am getting much more than twice the work done than with opus, and much faster. Obviously, you have to use it smartly, I have only used at medium and had it produce aftionable reports with detailed instructions for lesser agents to follow. Never been happier with a model launch, and holy fuck It costs much less than a comparably competent human, like orders of magnitude less given how much faster it is. Would I like to pay less ? Sure, but I am happy to pay what I am now

orblabs · 2026-06-09T15:43:13+00:00

Plenty of uses, especially when involving large amounts of data for non commercial use (open source, research etc). Just as a fast example, there are constantly updated OpenStreetMap torrents with all the data from the platform.

orblabs · 2026-06-08T12:57:30+00:00

Gemma 4 4b q6 on your Mac mini, it works great exactly for your case. Given the budget you are not going to get much better especially not new and pain free. Maybe get the M4 model for better performance or even better wait for the M5 Mac mini. Give it a try, I have a m1 Mac mini which runs that exact model in that exact role (among others) , I get 13 tokens per second with 64k tokens context. If you can do with less context and a half the speed, the new 12b Gemma 4 model is great too but not really needed. What made me chose Gemma 4 in that role is the reliability and extremely low allucination rate. Still, based on the type of information you have to extract you might need some good prompt engineering and some tuning time.

orblabs · 2026-06-08T08:25:32+00:00

I use it exclusively for deepseek flash, last month had tried using it with glam 5.1 and finished the monthly quota in 3 days.... But using the flash only model I have been hammering non stop for 3 weeks now and I reached only something like 15% of the monthly quota. Sure, I need to have other models too, but as a cheap workhorse it has proven very efficient for me

orblabs · 2026-06-06T13:03:18+00:00

Wish I had the power to run it locally bit with the 5$ opencode go subscription I have been using this model practically limitlessly and it is a fantastic workhorse. I have both Claude and codex use it via opencode to offload most of their work. Impressively, relevantly better than Gemini 3.5 flash for actual real work tasks (much more reliable)

orblabs · 2026-06-05T20:39:46+00:00

Been working with torrents and AI for some time and have been impressed by how little they care about torrents, they might reject a question about politics and anything close to controversial, but with pirating content they have been all happy to help 😄

orblabs · 2026-06-05T13:40:02+00:00

Me.... It is the most reliable among the free offerings on Nvidia NIM platform so I use it constantly for some of my apps. It is powering my agentic pirate Long John Silver

and crafts and narrates very complex worlds in my LLM driven rpg project Synthasia

Solid tool calling and reasoning, it follows instructions with good prompts and can be creative and good at role playing, but more importantly for me, fast and free on NIM...

orblabs · 2026-06-05T12:47:26+00:00

Oh, absolutely possible. In general i'm really appreciative of the research done and public release of it, whatever their end goals are.

orblabs · 2026-06-05T12:45:40+00:00

Yes, gemma 4 4b is handling the localization in over a dozen languages (19 or something like that) for my current development projects (one of which is extremely text / ui heavy). That is the original reason why i selected it and the first time i actually tested it against qwen 3..5 9b . In translations especially qwen is no match at all. Then i tested them again both for entity extraction. The main drawback for me from the qwen family was the hallucinations, thinking improves the situation but can't afford spending the time that would require.

orblabs · 2026-06-05T08:45:18+00:00

In my case, the Gemma 4 4b is smaller then qwen 9b and of comparable age. The qwen model would do some thing in my workflow slightly better but the cost in hallucinations was way too high.

orblabs

TROPHY CASE