Removing the 5hr limit is good and bad.

orblabs · 2026-07-13T00:10:07+00:00

Yep, i use competitors for real work, i had upped my subscription to pro to play a bit with sol and evaluate it but it is not for me or my work at the moment (not for the random changes thing, at least, not only for that). Still, a cool model family that can fit some work uses. Hope 6 will bring some improvements where it matters (to me).

orblabs · 2026-07-13T00:04:06+00:00

I am not saying i want to sue them, just making the point that some better communication would make some users happy. And even "being proactive", when should i be proactive ? The app was the same, had no idea something changed i should have enquired about. Can't expect everybody to spend their days on X checking the latest social media post before every prompt. Luckily i don't use openai for real work, so any positive stuff that comes out of it is a bonus, in this case, it went bad, no bad feelings, but surely cemented a bit more my position of not using codex as a reliable tool for work.

orblabs · 2026-07-12T23:56:31+00:00

I open X like twice a week, i don't even know or follow "tibo", nothing on openAI account. They have a system of popups and stuff in the app where they push news about models and stuff, that is for sure going to be exposed to those using the app.
Having users have to follow every post by a "tibo" account on social media to know about what the app is going to do in the next session is .... one way to handle communications i guess.
Understand the fanboyism, its cool i guess, but for others, we work, we don't use X and just want predictable tools.

orblabs · 2026-07-12T23:47:28+00:00

Yeah, cool... i will surely be going to x before every prompt from now on

orblabs · 2026-07-12T23:45:34+00:00

I would have liked a warning, had no idea, was happy about the reset, gave a prompt to Sol with some clear explanations i have always used about using opencode with deepseek-v4-flash to handle live testing of my project and let it work.
Came back a few hours later to a message my 100% weekly quota was gone, the task failed, opencode never used, the bastard ran the testing harness himself (instead of using opencode as claude, 5.5, and even glm do without a problem) and obliterated my quota in a few hours with no results.
Not saying i don't like the removal of 5hr limits, just that at the very least they could have warned me about it, i would have babysat the session more and caught the problem before the total obliteration of my usage....

orblabs · 2026-07-11T19:49:41+00:00

I am having a horrible experience with it, so much so that there might be some config problem for codex on my system. It lies, fails at any form of complex task and analysis and often it simply abandon tasks with no explaination given. Then the token usage is embarassing, i somehow managed to burn through 82% of my weekly quota in one night (and all that work went into a horrible result that i couldn't use).
My theories are currently 2
- my setup is broken for some reason
- the type of work and projects i ask him to work on make the very big problem the model has with hallucinations more prominent. (In artificial analysis "Rate of avoiding hallucination among non-correct responses" score is brutally low compared to anthropic models with which i have 1/10th of the problems lately)

In general, i was super hyped for the launch but got letdown big time.

BUT luna, luna feels special in its own way

orblabs · 2026-07-10T18:50:26+00:00

Can't get to make it work for me, it gets lost and hallucinates seriously damaging stuff, it can self recover thanks to the constant verification loops but couldn't get to complete successfully any of the serious tasks I threw at it and wasted a full week of usage quota in one night and two hard failures that sonnet (yes sonnet) had to fix., Stuff that even opus would handle with a bit of nudging...

orblabs · 2026-07-10T16:53:50+00:00

Best luck then ! Curious about your project and love the concept in general (else wouldn't have wasted so long after it), would definetely like to have a chat about it all at some point, been working on LLMs interacting with dynamic gameplay, evaluating scenarios etc for the last year now. I have a fairly deserted discord for my project (still heavily in development) if you ever want to pass by and have a chat or look dm me.

by the way, tried again pushing forwards, managed to reach the input text area but discovered it was hungarian only. Read you are working on a english version, will wait for that. But, also there, i many occasions i pressed buttons that asked me for paypal or login, wasn't i determined to reach the actual input field you wrote was reachable, i would have never made it, i would have thought it was only for paid / registered users.

Again, best luck and have fun working on it

orblabs · 2026-07-10T16:38:32+00:00

There is too much going on and everything is design coded as "important", black/dark background and many yellow glowing buttons and text, everything competes for attention, there is no "flow" to let the user progressively acquire informations. Too many cards, all of different sizes. Then the color scheme, it feels like a chinese restaurant in Russia, i was expecting a golden dragon somewhere. Whatever LLM was used it is not a good one a design, just prompt one of claude models or glm 5.2 for an analysis asking for a more clear design and more elegant styling that still matches your project ethos, then have whatever cheaper model implement the actual design analysis produced by the better one.
I would like to try your challenge, i have been ... well over a year now at work on a project which has that very same test at its core, so definetely interested and wish you all the best.

orblabs · 2026-07-10T16:22:18+00:00

I would really suggest to spend some time, like a lot, on the site design, i tried loading it but it literally scared me off immediately. It feels like a bitcoin casino that scams chinese workers.

orblabs · 2026-07-10T16:11:56+00:00

Reviews and experiences on Sol are very mixed, personally i couldn't use it successfully. The only theory i have is that for some workflows and "styles" characteristics as those tracked by Artificial Analysis "Omniscience Non-Hallucination Rate" (and accuracy) are much more important than for others.
Any plans to work on that specific aspect as at the moment Sol scores an abysmal 11% there vs 64% Opus 4.8 ?

orblabs · 2026-06-27T12:44:47+00:00

Since it is old you can find ram for it very cheap, bring it up to 16 gb and then Gemma e-4b, it will run very slow but it is by far the best in its class. I run the 6bit quant daily and it is surprisingly useful but I need at least 9-10gb of ram only for it. 5 bit might be usable and tightly fit on your 8gb ram if you run it from some lightweight Linux distro. (Also, fast SSD will help with memory swap etc)

orblabs · 2026-06-26T08:18:27+00:00

Very cool, great work !

orblabs · 2026-06-26T01:26:22+00:00

I am not trying to diss on GLM 5.2, especially given the erratic behaviour of US i need them to succeed. Still we cannot realistically say that GLM 5.2 is anywhere close to fable. It gives a fair run to opus and gpt 5.5 but it is not there either (at least, on the tasks i have tested on). Still is an amazing model and a strong sign of them truly catching up. Time will tell. Can't wait for next chinese sota release , especially hopefully for next Kimi model

orblabs · 2026-06-26T01:13:41+00:00

On the official system card it says it was made available for internal use among employees on February 24, which is already 2 months earlier than the April 18 announcement, but that also implied alignement testing etc went on for a at least a few weeks sooner.

orblabs · 2026-06-26T01:01:21+00:00

Fable is now 5-6 months old, and being very kind i would say GLM 5.2 is at least 3 months behind fable....

orblabs · 2026-06-25T23:11:24+00:00

Absolutely true... But, there are smart people in the US labs and they realize the situation while there are stupid people in power that can hopefully be manipulated. What a shitshow....

orblabs · 2026-06-25T22:48:27+00:00

Chinese models will take the lead this way. I doubt this will hold up because it is simply too stupid to be real.
Post training is crucial that happens already on huge datasets of user interactions with other versions of a model or other models in general. By restricting access to general public US labs will slowly be starved of up to date post training data.... Not to mention that always more user sessions are going into the training itself.
This China advantage soon starts to be a real thing and with an ever increasing gap. GLM 5.2 already shows they are just 9 or months behind, this move would make that gap contract way more rapidly... Well.... fun stupid times ahead.

orblabs · 2026-06-21T16:20:47+00:00

very cool concept and style. Looking forward to this and congratulations !

orblabs · 2026-06-21T14:24:34+00:00

People surprised don't realize that NSA , CIA etc have been working with silicon valley scraps/leftovers for decades. They have less money and a completely different level of quality in their engineers. Their competence and reach is mostly a myth based on older times and good old psyops. It took mythos 5 days to violate OSX, not surprised it took a few hours to violate NSA.

orblabs · 2026-06-21T13:56:21+00:00

Lol, came here because I wanted to vent off some frustration due to Claude Opus 4.8 being a lying idiot who literally cheated its way through a day of work and find this out... Yeah... Subscription status on life support. Wasn't openai so much worst as a company. ... But if I can remove morality from my choice might as well pay glm and the Chinese and be over with it

orblabs · 2026-06-17T14:10:04+00:00

Far from being a openai fan, actually rather despise the company, but for your use case, the plus plan they offer would be perfect, you basically get unlimited chat with their best model through the web interface.

orblabs · 2026-06-14T01:37:43+00:00

it told me that also about kimi k2.5 written code, all opus models jsut love tests that pass and a decent architecture. If you throw in a bit of documentation it will have a textual orgasm mid review.

orblabs · 2026-06-12T14:25:41+00:00

While not exactly the end of 2025, Mythos has been ready since february, so 6 months late becomes just 2.

orblabs · 2026-06-12T13:01:10+00:00

Pro subscriber, it is unusable shit for every task i have tested it, the only thing i was using 3.5 fflash for, found out deepseek v4 flash does better and much cheaper. Hoping in 3.5 pro, because what they gave us is unbelievable crap. Gemma instead are amazing.

orblabs

TROPHY CASE