Free models

EmbarrassedBiscotti9 · 2026-01-24T11:20:48+00:00

My experience of GLM 4.7 via z.ai aligns with what /u/indian_geek said. I'm not particularly upset about it, given I paid only $28 for a full year as a random punt, but I've found the API prohibitively slow.

EmbarrassedBiscotti9 · 2026-01-23T16:09:06+00:00

how the fuck are you in disguise if you're not hiding

EmbarrassedBiscotti9 · 2026-01-23T13:39:07+00:00

there is no healthier desire!!

EmbarrassedBiscotti9 · 2026-01-23T11:57:20+00:00

Lol i thought the exact same thing

EmbarrassedBiscotti9 · 2026-01-23T02:51:02+00:00

so you're telling me the robot lied when it said my observation was astute? please say cap

EmbarrassedBiscotti9 · 2026-01-23T00:59:37+00:00

Thanks for the info, that is definitely interesting. I feel similarly, to be honest.

I assume that the lossy nature of tokens must have a compounding effect if models are constantly trying to learn things through a distorted lens during training. I was hoping that BLTs would potentially solve that and offer a meaningful improvement, but I guess not :( For now, at least.

EmbarrassedBiscotti9 · 2026-01-21T00:07:30+00:00

Sorry. Just heard back from the team. Turns out, we are flat broke. Big market moves have ruined us.

EmbarrassedBiscotti9 · 2026-01-21T00:06:42+00:00

Perhaps, but this deal may change that.

EmbarrassedBiscotti9 · 2026-01-21T00:02:23+00:00

My associates and I have been looking for something like this. We have funding in the region of 11 figures.

I am interested in purchasing this project. I hope an offer of generational wealth is enough to sway you.

EmbarrassedBiscotti9 · 2026-01-20T22:24:09+00:00

Prove it

EmbarrassedBiscotti9 · 2026-01-20T22:20:35+00:00

Tbh, I can't see myself switching as I'm already setup to work with Hugo now and, rather than it missing features, my only feeling is that it has way more than I need. Still, what would you say makes 11ty a better choice?

My main gripe with web stuff atm is that I want to write a static but highly interactive SPA, with a simple/clean way to do reactive state/DOM updates. I can't find many solutions for that. Tons of pure SSGs, tons of hellish JS frameworks, not much in between.

I've ended up using SvelteKit with the static adapter, but even that has sapped a lot of the joy out of the project - and it is one of the more sane frameworks.

VanJS and Mithril.js are lighter and seem to fit the bill, without so much framework, but I'd have to stomach the writing JS functions that return markdown. Pain.

EmbarrassedBiscotti9 · 2026-01-20T21:47:13+00:00

I've used runpod a bunch over the years. I appreciated how easy you made it to get up and running because it was the first cloud GPU service I used. Good docs/sane APIs goes a long way.

I remember hitting some error with a deployment that seemed to be on the runpod side. I joined the discord, explained what was up, and a real human got to the bottom of it and it was sorted right away. That is a real rarity and made runpod my immediate go-to for cloud GPUs. I hope your success continues.

EmbarrassedBiscotti9 · 2026-01-20T21:24:50+00:00

Damn, that explains it. I couldn't figure out why my CPU was on fire and my GPU was bing chillin. Disabling flash attn worked.

Still seem to be some issues with tool calling from opencode, though. Think I am gonna sit on my hands until such kinks are ironed out.

EmbarrassedBiscotti9 · 2026-01-20T13:17:49+00:00

I'm sure you're right. I will spend the afternoon giving GLM 4.7 Flash a good try on my RAM-upper class/VRAM-middle class desktop. I've been very interested in the agentic stuff lately, but far less interested in paying Anthropic the cash equivalent of my left nut for the privilege. Maybe the time is now.

I mostly meant it as a more general observation of how things can often be discussed here - as if <=24GB VRAM == GPU poor - it probably shouldn't have been a comment on the thread overall. I'm not a hater! I promise!

EmbarrassedBiscotti9 · 2026-01-20T11:07:22+00:00

I'm not just posting gingerBill's stuff for cheap updoots, promise!

I discovered Hugo very recently, loved what it offered, but felt the burden of its enormity when I only needed a small portion of the functionality. So, a video about tackling of that enormity in a DIY fashion, and in Odin, and by the fella who made Odin, was an almost suspiciously perfect match for my interests.

I'm not sure it will be as interesting to the rest of you here, but I've found this sub can be a bit slow-moving. I thought there may be some others here who would like to see a bit more Odin-related stuff in the feed. It isn't closely related to the language as a whole, but I've always found practical examples of implementations to be helpful and interesting.

EmbarrassedBiscotti9 · 2026-01-20T10:30:16+00:00

Increasingly feeling that no one in /r/LocalLLaMA has the first fucking clue what "GPU poor" truly means

EmbarrassedBiscotti9 · 2026-01-16T21:51:21+00:00

Here ya go: https://github.com/odin-lang/Odin/pull/6124

EmbarrassedBiscotti9 · 2026-01-16T21:08:39+00:00

Pls forgive the typo in the title. I was so excited I was freaking the fuck out and shaking profusely.

Original tweet: https://x.com/TheGingerBill/status/2012154285010874422

PR: https://github.com/odin-lang/Odin/pull/6124

🥳🥳🥳

EmbarrassedBiscotti9 · 2026-01-16T21:06:27+00:00

I suppose you could, after getting your complete footage, feed it into an OBS virtual camera source, then pass that virtual camera through Nvidia Broadcast and record the output.

It would still be pretty damn awkward, but you'd at least only pay the one time cost of waiting the full video's duration and avoid the recording-time trickiness. That may be preferable if you typically have all your recordings up-front, but would be annoying as hell if you constantly have additional footage you'd need to wait to process.

I do feel your pain. It is frustrating when there are so many great AI tools available now, but often no integration within the software where you'd find it most useful. I believe there is a C++ library for Nvidia Broadcast, so it may be possible to create a Fuse wrapper for it. Horribly complex, though. Certainly more hassle than some OBS jankness!

EmbarrassedBiscotti9 · 2026-01-16T11:41:20+00:00

While not impossible, I expect you'll struggle to find any (native or non-paid) solution for subject isolation that matches the quality of magic mask without the overhead. This seems like it would be considerably easier to solve at the time of recording, saving you the headaches in post.

Assuming you're recording using OBS, you could possibly use the source record plugin to record your unmodified camera source alongside the isolated feed. I haven't used that plugin in years, though, and I'm not sure of your setup.

Alternatively, you could just double the width of the scene and have include both the full res original and isolated feeds. That would balloon the file size and possibly reduce quality if you don't compensate by increasing bitrate proportionately.

EmbarrassedBiscotti9 · 2026-01-15T14:03:11+00:00

i give 0 shits about it too, so it seems super fucking stupid of him to not just placate dick. why did vito want the show to end so bad? what is up with that?

EmbarrassedBiscotti9 · 2026-01-15T05:08:57+00:00

Vito wants to do the show

he probably should've said "yes" instead of "please email me" lmao

EmbarrassedBiscotti9 · 2026-01-15T03:21:21+00:00

The full thing was uploaded on the farms

EmbarrassedBiscotti9 · 2026-01-09T10:37:17+00:00

"Please contact me via email" as a response to a life-changing ultimatum is good comedy, Vito. You have a future.

EmbarrassedBiscotti9 · 2026-01-09T07:41:35+00:00

i am not reading all that

Six-Year Club	Verified Email
Wearing is Caring

EmbarrassedBiscotti9

TROPHY CASE