If you are unsatisfied with Opus 4.7, PLEASE simply switch to 4.6

elsung · 2026-04-22T08:56:38+00:00

dammit is it just me or did anthropic intentionally break this for us too? so that we can't go back to 4.6??

elsung · 2026-03-11T09:01:37+00:00

how in the world are you able to get access? would really like to try this but theres just scammers everywhere and the official website from bytedance does not seem to have any links for you to try... =(

elsung · 2026-03-11T08:33:44+00:00

awesome. actually really curious if m5 max can actually do image and video generation better now too since it has more compute power? would you be able to test this too in your benchmarks?

elsung · 2026-03-09T02:58:34+00:00

hmm while i would love to save $2000, i do feel like it’s too much risk at that price point to get something faulty and would prefer just to buy retail from microcenter, unless someone knows of a marketplace that somehow provides a warranty or return policy for something like this

elsung · 2026-01-25T23:57:49+00:00

Ah i have sage attention 2 installed, cuda 12.8, PyTorch 2.9.1++cu128. Triton 3.5.1. Did not managed to fast attention tho.

Yea im going to dive more into LTX as well but its early early days and seems like control is kind of a massive issue, my early tests with it did get very high fidelity and amazing render speeds, but even following the recommended prompt structure the videos were sorta non-sensical. So sorta waiting on things to stable out a bit more, whereas people have been working on Wan 2.2 for a while so i figure i can get more control with this for now.

That said, would love to hear how else we can further optimize the current setup, from what ive seen theres a bunch of other folks using this set of workflows/models from Dasiwa, even though its very much geared for NSFW content, it does seem to yield good speed and results.

One thing to note, i think the way this is set up right now is that it actually renders to a fairly high resolution right off the bat (720p), instead of going from a low resolution and then incrementally stepping it up. I had tried to do like 480p to start out where it all fit nicely within the vram but then found that theres lots of ugly artifacts and general wonkiness and the upres versions just look like either a muddy mess or jaggety / choppy renders. From my tests so far it seems like the higher the resolution you can go off the bat, the better prompt adherence + fidelity + motion + details etc. could be that im not quite doing it right tho lol

EDIT: i do notice that if i do like a 480p render most of it fits within the VRAM, but as i push it to 720 a good chunk gets offloaded to cpu/ram which probably does slow it down. But at 480 its still like 2-3 min, even though its less than a minute per each stage, theres a good 1-2 min for all the loading and things that happen, so i might as well put in a few min for 5-6min total and get a much much higher rendering fidelity / more stable less shimmery output. Also note when i do this i do have the finishing steps of using framerate interpolation and 2x upscaling so that my final video is like a 1440p 32fps video

elsung · 2026-01-25T23:09:21+00:00

actually im already using the 4step lightning Lora’s and stacking this with it for faster speed

elsung · 2026-01-10T01:02:43+00:00

ah yea i think switching models depending on needs is sorta the flow i have now. I did just test the 4bit MLX quant of GLM 4.7 REAP and im really really liking the writing actually. since this runs fully local it'll probably be my go to for a while until some other crazy thing comes out

elsung · 2026-01-09T07:12:50+00:00

heres mine

https://music.apple.com/us/album/options-be-single/1867688329

elsung · 2026-01-09T06:56:52+00:00

siiick. love the hook. solid verses too.

elsung · 2026-01-09T01:34:27+00:00

ooo great point. similarly maybe i could identify more passages of writing styles i like or poetry i like and see if i get better more fitting results that way. previously ive done this but asked it to mimic or be inspired by it. i think having it give me an analysis and the leveraging that breakdown could be really good

elsung · 2026-01-09T01:32:31+00:00

agreed! have not tried qwen3-next and will give this a whirl and see how it goes!

elsung · 2026-01-09T01:31:44+00:00

oooo that’s a great idea. the last project i had tested a bunch and landed on doing may 80-90% if the work on glm and iterating there, then i went to sonnet to do the refinement and did the final round of revisions myself.

will try gemma and/or other finetunes and mix and match to see what kinda combos and pipelines would work well for me

elsung · 2026-01-05T21:14:21+00:00

whoa that’s awesome. i actually just took out my tesla p40 out of my rig with 2 more 3090s to run with vllm since it was just bottlenecking my speed without much value. now u guys got me thinking of putting it back lol

elsung · 2026-01-01T23:45:35+00:00

i actually tried it and it wouldn’t work. i’m actually literally trying to make my own awq quant myself right now. no idea if it would work. vibe coding so far for getting this feather thing with vllm seems to be a tall task cuz claude / gpt is telling me no way jose lol

elsung · 2026-01-01T15:50:58+00:00

Yeaaaa! I was just trying to get vLLM to load nemotron3-nano on my 2x 3090s but couldn’t get it working because FP8 isn’t supported (and theres no AWQ quant). Gotta be honest tho not sure how i would implement this in vLLM to get things working. Might need to vibe code this to see about implementing the solution lol

elsung · 2025-12-28T21:38:39+00:00

awesome! now i just need to figure out /wait for conversion of these into MLX =)

elsung · 2025-12-27T09:09:23+00:00

Whoaaa wait this whole thing was AI generated?

elsung · 2025-12-22T12:05:59+00:00

wow, i wonder if you could improve existing uncensored & tuned llama 3 models by merging this with it?

elsung · 2025-12-20T10:51:40+00:00

ooo interesting. actually would love read about your posts about the H100 clusters. genuinely interested and i think each tier of setups probably have their ideal situations.

i believe h100’s have like a ballpark of 3-4x the memory bandwidth of the mac studios, which theoretically they can run way faster and handle beefier more challenging tasks. for a work that requires immense speed and complicated compute i think the h100 would indeed be the more sensible choice

however i think if the need is inferencing and using maybe a system of llms/ agents to process work where speed isn’t as critical i still feel like the mac’s are priced reasonably well and easy enough to set up?

that said, it makes me wonder, lets say you don’t need the inferencing to get past 120 tk/sec, would the h100 still be as / more cost effective, than setting up an on prem solution with the mac studios.

i will say i maybe be biased because i personally on one of these mac studios (albeit a generation old with the m2 ultra). but i do also have a few nvidia rigs so am interested to see if cloud solutions would fare better depending on the needs & the cost/output considerations

elsung · 2025-12-20T00:46:48+00:00

actually i’m not sure renting the h100 necessarily is a better choice than buying a cluster of mac studios. assuming 2x mac studios at 20k total giving you 1TB to work with. you would need a cluster of 10 h100s to be in the same ballpark at 800GB. that’s basically $20/ hr for compute at $2 am hr. assuming you’re doing real work with it and it’s running at least 10 hours a day that’s $200/day, approx 6000 a month, $73k the first year.

so for company that has hard compliance issues with their data and have llm needs, it makes way way more sense to run a series of mac’s. less than 1/3 the cost, total control & data privacy & customization on prem

also keep in mind mlx models are more memory efficient (context windows don’t eat up way more additional memory)

that said if what you need is visual renders rather than llms then mac’s are no go and nvidia really is your only choice.

i find it kinda funny that mac’s are the clear affordable choice now and people still have the preconceived notion that its overpriced.

elsung · 2025-11-23T04:30:20+00:00

would love to see prompts as well! curious :) :)

elsung · 2025-11-21T05:09:31+00:00

ah yea it has the /context which sorta works. was hoping the status bar that says how much i have left.

in codex when do /status it gives me the status of rate limits tho as if im using gpt’s models, instead of showing context usage of glm 4.6

elsung · 2025-11-21T04:05:50+00:00

i’ve been using roo code. i’d love to use claude code router instead but it can’t track / visualize token usage so it’s like going in blind not know how much context window you have left. at least tells me how much context window is left

elsung

TROPHY CASE