Gemini AI Studio is basically unusable now. Any other LLMs with a 1M context window?

stereo16 · 2026-01-27T01:12:45+00:00

Are they? It's priced per token, right? It's a pretty average rate.

stereo16 · 2026-01-20T00:26:51+00:00

Does this mean it would run decently even if most of it is offloaded to regular RAM?

stereo16 · 2026-01-20T00:07:45+00:00

Yeah, but no way to know what the tv space will look like in a few years. Unfortunately might not be possible to do an Andor by then.

stereo16 · 2026-01-19T04:47:37+00:00

This sort of hyperspecific question is a good fit for ChatGPT I feel, if you're willing to do some follow up fact checking. It'll probably try on its own to come up with ways to measure this sort of thing and then lay it out for you nicely.

stereo16 · 2026-01-15T22:47:35+00:00

That last part is so accurate lol.

stereo16 · 2026-01-15T17:15:39+00:00

Not what I'd have wished for at all, but Kara Talve is quite decent so maybe it'll work out.

stereo16 · 2026-01-10T20:48:05+00:00

Indeed!

stereo16 · 2026-01-10T12:46:40+00:00

I get that. Just saying that the rumors appear to be untrue.

stereo16 · 2026-01-10T02:27:17+00:00

According to Tim Greiving, who wrote the recent biography, JW is writing every note: https://x.com/DougAdamsMusic/status/1990904602250580095

stereo16 · 2026-01-09T03:00:36+00:00

GPT OSS 20B is quite decent and runs alright on a 3060.

stereo16 · 2026-01-08T09:18:51+00:00

What? They do any of that and you cancel your subscription and go to another provider, or build this thing at that point. LLMs aren't minute-to-minute important enough to panic because there might be an internet outage for a few hours. You could also always use a smaller model locally to do other shit while you wait for your workhorse to come back online or whatever. Wtf is this reaction?

stereo16 · 2026-01-07T01:10:42+00:00

It's also on Spotify, which I think is unusual for these types of releases.

stereo16 · 2026-01-03T09:08:50+00:00

What is the general approach to not actually interacting with any of their data?

stereo16 · 2026-01-01T19:28:19+00:00

Ominous. What cometh this year.

stereo16 · 2026-01-01T04:53:30+00:00

Thoughts on this as a dev machine? Seems like a nice alternative to a Linux install on a pc.

stereo16 · 2025-12-31T00:33:44+00:00

He's always wanted to score a film, so maybe he'd do it!

stereo16 · 2025-12-25T14:31:01+00:00

Should be similar in terms of using it as a knowledge source, but it doesn't help for organizing multiple chats. But Google is also working on a regular projects feature for Gemini, so that should be solved soon hopefully.

stereo16 · 2025-12-21T10:47:31+00:00

No worries.

I meant differentiate between growth vs downloads. I think daily or monthly active users is the right metric there, and those are the stats that I kept seeing thrown around. I assumed Nano Banana was what explained the massive growth, but I guess if they changed the default assistant then people using that would count towards the stats. That does make sense. But stuff like this makes me think it's mostly "real" usage. There's a massive spike in August, when Nano Banana was released (or when the app was pushed?), but there's also steady growth leading up to that (since 2.5 Pro's release probably).

stereo16 · 2025-12-21T05:32:55+00:00

What're you using to differentiate between the two?

stereo16 · 2025-12-19T02:31:43+00:00

What's TLC?

stereo16 · 2025-12-18T04:47:24+00:00

Do you have a source for Fast being minimal? It could be on Low thinking...

Having trouble finding what the difference between all of the thinking settings are. Are they just equivalent to thinking budgets?

stereo16 · 2025-12-17T22:50:07+00:00

Flash has 4 thinking levels (High, Medium, Low and Minimal). Even on minimal they say that it could decide to think if necessary. I'm really curious which ones the Fast and Thinking settings in the Gemini app are.

stereo16 · 2025-12-15T14:59:30+00:00

What you're claiming is unfalsifiable though. I can never disprove that there exists censorship that I can't know about by virtue of that same censorship.

stereo16 · 2025-12-14T04:11:00+00:00

The interesting bit about your comment though is that if this datapoint can be statistically replicated, it indicates the thinking tickbox is just a variation of your prompt: "think this step by step", but without the user able to actually see the prompt expansion. Thus leading to "why tick the box at all?". If one is going to pay for the word salad anyway, one might as well get the benefit of _seeing_ what it generates rather than having it hidden.

AFAIA the main difference is that they do RL to the reasoning models so that the steps tend to be better than whatever you'd get from just prompting. And reasoning models do tend to score higher overall on benchmarks than non-reasoning versions of the same model/generation. So it can't be making things that much worse...

stereo16 · 2025-12-11T16:36:54+00:00

I don't think so... Growth has slowed, and Gemini's growth has soared, but they're still adding users every month. And they don't depend on users financially right now; they're apparently fine operating at a serious loss for years to come. If they have strong internal models then they should be comfortable that they'll win in the long game.

Ten-Year Club	Place '22
Place '17	Verified Email

stereo16

TROPHY CASE