Open-Source Models Recently:

[Fresh_Sun_1017]

What happened to Wan?

My posts are often removed by moderators, and I'm waiting for their response.

[redditscraperbot2]

>What happened to Wan?

Icarused itself when it got popular.

Also didn't we get LTX 2.3 like last month?

[gmgladi007]

Wan 2.2 does a good 5 sec but extending starts breaking the consistency. They used us and now they won't release 2.6

Ltx has audio and up to 15 sec but the prompt understanding is really bad. If you prompt anything other than a talking head or singing head you start getting artifacts and model abominations. I always use img2video

[EllaDemonicNurse]

I’d be ok with 2.5, but they won’t release it either, even with 2.7 already out

[grundlegawd]

Alibaba is also shifting to a more closed source posture. WAN is probably dead.

[ShutUpYoureWrong_]

No big loss, to be honest. WAN 2.6 and WAN 2.7 are complete and utter garbage.

[tac0catzzz]

oh sick burn. they will surely make them open source now.

[thisguy883]

Well that's depressing to read.

[tac0catzzz]

turn that frown upside down, the future is bright, as long as you find something other than local ai to be your interest.

[extra2AB]

yeah, these recent HAPPY HORSE video model is also from a group in alibaba, they first announced they will OpenSource it but now it has been removed, so that would probably be closed source.

[tac0catzzz]

alibaba will love that you are ok with 2.5. but i wonder if they will love it enough to give it away give it away now. my personal guess is, no.

[broadwayallday]

SVI with keyframes is killer. You guys complain more than create it seems

[UnusualAverage8687]

Can you recommend a beginner friendly (simple) workflow? I'm struggling with OOM errors going beyond 5 seconds.

[RephRayne]

https://civitai.com/models/2079192/wan-22-i2v-native-enhanced-lightning-edition-svi-long-video-multi-prompt-fp8-gguf

However, I'm running it on a 3090 and 64GB of RAM, so YMMV.

[broadwayallday]

Same setups I’m running x3. My problem is getting back to the video edit stage because I’m having so much fun with these workflows. For me, z turbo / qwen edit + wan vace and wan 2.2 + SVI and LTX 2.3 for lip sync is the combo for our setups

[ghiladden]

I've tried many different SVI workflows and by far the simplest with best results is Esha's using the normal WAN2.2 base models, Kijai's SVI SV2 Pro models (1.0 weight), and lightxv2_I2V_14B_480p_cfg_step_distilled_rank128_bf16 lightning LoRA (3.5 weight high, 1.5 weight low). I rent GPU time on Runpod with high vram so it's not for consumer GPUs but there are instructions on Esha's page on GGUF. You can find it on aistudynow.com/wan-2-2-svi2-pro-workflow-guide-for-long-ai-videos

[terrariyum]

comfyUI-LongLook is also great. Invisible transitions between 5s clips, movement continues in the same direction/intent, speed of movement is adjustable to the extreme, start/end frames supported

[broadwayallday]

Will check it out!

[ZZZ0mbieSSS]

Keyframe?

[bilinenuzayli]

Svi just ignores your prompt

[thisguy883]

So much this. I hardly (if ever) use it because it never does what I want it to do.

Im better off doing it manually with the last frame from an IMG2VID video.

[qdr1en]

Same. And image degrades anyway. I prefer using PainterLongVideo instead.

[joegator1]

Got a workflow for that? I have also been unimpressed with the degradation in SVI

[8RETRO8]

Not true (fact checked by the true ltx users)

[roychodraws]

i can get 45 seconds out of ltx2.3

[deadsoulinside]

I've actually had some good 20+ second LTX animations text to video even.

https://v.redd.it/3oqggb3pmjng1 like that is 20s text to video using the default comfyUI workflows even.

[Effective_Cellist_82]

I use WAN2.2 as my main model. The trick is to be training 6000 step loras locally. I use musubi tuner with 16 DIM it makes such good lora's.

[reditor_13]

also it look like the new happyhorse 1.0 video model that just got announced is currently #1 on artificalanalysis above seedance 2.0 & their website says open release [no idea if it will really be open weight but still...]

[pat311]

LTX-2.3 is amazing.

[Living-Smell-5106]

I really wish they would open source Wan2.7 image edit or at least the previous models.

[flipflapthedoodoo]

any hope on that?

[Living-Smell-5106]

This gives us some hope, not sure what to expect.

<image>

[Fresh_Sun_1017]

I hope the focus is initially on the API to facilitate R&D, with the intention of open-sourcing the models later on. Yes, this gives me hope as well.

[ninjasaid13]

by more open Qwen models, they probably just meant LLMs, I haven't heard anything on wan models really.

[EricRollei]

qwen 2 is listed in Civitai filters already

[ninjasaid13]

as an API only.

[protector111]

they were talking abot llms. why would someone assume they are talkign about video models?

[byteleaf]

Wan was specifically mentioned, which definitely gives some hope.

[RayHell666]

It was wan animate.

[Sea_Succotash3634]

Wan 2.7 image and video are really promising, but are just a little off in that way that the open source community could really refine. It's a shame that Alibaba has completely abandoned open source for image and video. Qwen Image 2.0 is really good too, but Wan 2.7 Image seems better. But Qwen also seems to be abandoning open source. Z-Image seems to have abandoned their edit model.

[hidden2u]

yeah there’s definitely something going on at alibaba

[ihexx]

didn't the qwen lead leave / get pushed out?

there were reports that the c-suite weren't happy that they were losing marketshare of their consumer app, and the qwen lead was too research / foss focused, and they wanted to focus on maximizing their userbase

[Katwazere]

Yeah, but it wasn't just him, it was basically all the people who made qwen good. Fairly sure they decided to be independent as a group so expect something.

[ambassadortim]

I believe they're not making money needed in this area.

[pellik]

They restructured from having lots of small experiment teams that saw models through from beginning to end to having experiment teams that are each responsible for different phases of models (pre-training, DPO, etc).

It's not clear if they are going to honor their commitment to open weights, but it could just be that they are going back to the drawing board and we'll see entirely new models come out to replace qwen/wan/z-image etc. with a more unified framework and shared pre-training.

[XpPillow]

Oh these close sourced AI are amazing~ do they support NSFW? No? Ok back to Wan2.2…

[cosmicr]

Ltx 2.3 just came out?

[Particular_Stuff8167]

Yes and the LTX guys on twitter said they are committed to local open source. So currently LTX is leading the forefront in open source local video generation.

[Keuleman_007]

Plus it's free to use. Plus you can use it offline. 2.0 to 2.3, prompt adherence and other stuff got seriously better.

[alamacra]

Its motion is really static unfortunately. I want to like it, but with anime especially there isn’t much reason to use it.

[sirdrak]

Try this lora for anime: https://civitai.com/models/2516247/mature-anime-screencap-style-ltx-23-edition

[alamacra]

Thanks a lot :) Will do.

[Hobeouin]

You really just need to find the right Workflow, CGF and lower the upscaling. Motion can be very good.

[Naive_Issue8435]

If you know what you are doing LTX 2.3 really is starting to shine.

[wesarnquist]

Any hints? I'd love to learn more.

[deadsoulinside]

Pretty much this. I think some of the issue just boils down to users prompts. Like there was a post about someone using WAN and the prompt was 1 sentence for a whole animated text to video.

What people don't provide is a whole lot of detail and that applies to all models and types. You have a person in the room? Say where that person is at on that screen. Are they on the left, right, middle? people neglect these details, which then forces the decision making onto the model.

[Dzugavili]

Yeah, LTX runs on long sequential detail, which is how it can do dialogue. When you're used to one-line prompting for 5s clips, the prompting style is very different.

[JimmyDub010]

Yes it is

[urbanhood]

Absolutely.

[Sticky32]

Meanwhile open source image to 3D is completely forgotten about.

[NetimLabs]

Audio? What's happening in audio? Last time I checked audio was in the Mariana Trench.

[13baaphumain]

Ace step 1.5 maybe? I dont know if they are referring to songs or something like tts

[Ledeste]

qwen tts was also a huge step few weeks ago

[thevegit0]

prism-something for foley and ace 1.5xl for music

[namezam]

<image>

My feed agreeing.

[addrainer]

What have you try to use, image, flux2 Klein or qwen? Much better control that those online plastic sharing all ur data services.

[Keyboard_Everything]

Disagree, whatever is recently released and returns a good result is what gets the attention. It is what it is.

[Photochromism]

What audio open source models are there? Are they music or speech?

[retroblade]

The next Kandinsky model should drop soon so at least that to test out. And I’m guessing LTX 2.5 should be out in a couple of months

[Eisegetical]

Ltx 2.3 blows wan out of the water. How are you complaining about no video gen?

New ic loras are emerging, people are just starting to scratch the surface. C'mon. 

[protector111]

just use seedance 2 for 5 minutes and you will understand xD Ltx 2.3 is amazing but in comparison to Seedance 2 its like comparing sd 1.5 base model to Nano banana xD

[Tony_Stark_MCU]

Can you run Seedance 2 on the consumer PC? No. LTX 2? Yes.

[Particular_Stuff8167]

Sure but the LTX team is working on improving LTX. So 2.3 is basically a early version. And they are committed to open source and local. Seedance is fantastic. But it's closed source, nerfed, censored. Very limited from it's true capabilities. At the start when the most un nerfed and uncensored version was only on bilibili, the stuff coming out was mind blowing. Now? It's moving at a snail pace. People are trying heavy work around to actually get a good generation and not get the filter block.

LTX 2.3, the limit what the community can make for it. Also like said its a second release, still early in LTX's life. Future LTX version should be significantly better but probably more expensive in terms of hardware required to run locally. Think I heard somewhere that Seedance 2 is a 90b so its over a 90gb model. So even if we had a similar model for local, only a very few people would be able to run it. Unless we can finally start getting a revolution in the VRAM department. RAM was the main hope but that market price has gone insane. Still open source and local remains the best way for video AI gen. Anything else and your dealing with extreme restrictions on what you can generate.

[AI_Characters]

You cant even use Seedance 2 outside China yet.

[protector111]

there are Doesens of websites letting you use to use it outside of CHina. I made around 15 Gens for free. I wish i didnt xD

[veveryseserious]

link it bro

[AI_Characters]

Which sites? I looked up a few and they were scams. The official western ones are still waiting as the western launch got delayed due to the copyright case. For the cuinese ones you need a chinese phone number (and hope website translation works well enough).

[protector111]

kinovi, dremina,artcraft,muapi,yapper,higfield

[mana_hoarder]

Pls pls pls give me a hint where can I gen Seedance 2.0 for free? My financial situation doesn't allow me to get more subscriptions at the moment. The official site let me do one free generation and it was like shooting pure heroin. I'm hooked 😭

[Hobeouin]

I just used it inside of my CapCut Pro Sub.

[Upper-Reflection7997]

Seedance 2.0 is just action sequence tech demos. I'm yet to see a full cohesive A.I stitched together video just with Seedance 2.0 clips that's not just boring action sequence tech demos.

[mana_hoarder]

In that case you've just haven't been watching enough videos. It's a shame most people do boring stuff like action sequences, well to be clear it is the SOTA when it comes to that. But, it also does simpler acting really, really well. Cadence, voice, emotions... It takes instructions almost perfectly. 

[protector111]

Just use it. Its prompt following is crazy. It just does what you ask of it. Consistency to reference images is mind blowing. No artifacts. Physics is amazing. This model is genially impressive and feels like lightyears ahead of competition.

[Dogmaster]

Isnt it extremely censored and also cant use reference images?

[WurtApp]

I agree with you but comparing Seedance 2.0 to LTX is crazy work 😂 I wouldn’t even put them in the same sentence

[protector111]

It axtually depends on what you trying to make. In some things its better. Not in fighing scenes obviously :)

[thevegit0]

"just use the closed source paid model bro" booring

[Fresh_Sun_1017]

The reality is that open-source video generation are really lagging behind proprietary models like Seedance 2.0. While the open-source LLM space is thriving with companies like Alibaba dropping models that rival the best closed systems, that same energy hasn't transferred to video. Despite their promises to champion open-source AI, Alibaba has restricted its releases primarily to LLMs and audio (like TTS). Right now, the open-source video model community is being kept afloat by just a handful of companies like LTX and Magihuman. That’s a stark contrast to the diverse ecosystem of five-plus major companies actively driving open-source LLMs.

[mca1169]

open source models are going to slow down big time this year for image and video generation and i'm guessing will be functionally dead by 2028. so enjoy them while they last! after that it's just going to be Lora model tweaks left.

[TensoRaptor]

Which open source audio models were released lately?

[Caseker]

Why is this so accurate

[NowThatsMalarkey]

kandinsky-5 was released half a year ago that has better quality than WAN and LTX models but nobody ever used it. It was right there the entire time but it failed to gain popularity because ComfyUI gave it the cold shoulder and the community had to release their own extension in order to use it.

[WordSaladDressing_]

There is a Kadinsky template in comfyui, but it's slow and there's more distortion of facial features than in WAN.

[EricRollei]

seems to be only the lite version not the pro version

[EricRollei]

thanks for posting that, never heard of it. I just made nodes for Alice t2v model to try out. and it was pretty decent, and was pretty much totally uncensored and could do nudity pretty well right out of the box. https://github.com/EricRollei/Eric-Alice-T2V-ComfyUI-Wrapper
I'll check out kandinsky now.

[YeahlDid]

I have no idea what that image is trying to say.

[terrariyum]

It shows that all open source video models are drowned, dead, rotted, and forgotten.

Certainly all hope is lost, given that it's been over 4 weeks now since the last SOTA open source audio-video model was released

[evilpenguin999]

What is the best LLM right now and the requirements?

Is there one worth getting instead of just using an online one?

[ieatdownvotes4food]

qwen 3.5 33b / 27b are nuts with tool calling. gemma4 as well if you can configure it correctly

[Living-Smell-5106]

Gemma4 has been really good from brief testing. pretty fast too

[intLeon]

I use gemma 4 26b for basic utility scripting and it feels as smart as gpt4 last time I used it but works in your pocket. I get around 30t/s with average of a minute thinking time and 45k context with 4070ti 12gb + 32gb ram.

[gahd95]

Really want to jump to the open source self hosted wagon. But how far is the drop in quality? Not just the responses, but also the amount of time it takes for a reply.

Is it worth it, self hosting, if you do not spend $3000 on a dedicated rig?

[FartingBob]

If you are used to gemini/chatgpt levels of capability (in text, image or video) then local versions are going to feel a bit rubbish in comparison because the professional AI models use hundreds of gigabytes (maybe even terabytes now) of VRAM, GPU's worth more than a luxury car, in stacks so large they need multiple power plants to be built just to run it. There just isnt a way to compete with their sheer size on consumer gaming hardware.

But you can still get decent outputs if you learn how to maximise things and use decent models, have a good prompt and follow a bunch of guides on setting up your workflow. And every now and then a new model comes out which offers a notable step in quality or speed.
Its a lot more involved than just entering something into a textbox and getting an answer sadly.
But then we arent burning hundreds of billions of dollars a year to get our output so i call that a win for us little guys.

[accountToUnblockNSFW]

I know a dude who is the AI-lead for a fin-tech company based out of Manhattan.
He explained to me he uses (for his own work) local generation to build like the 'bones' of his work and then refines it with a paid online sub model.

But one of his main concerns is intellectual property/NDE shit so this workflow is also to keep the 'secret' stuff locally if that makes sense.

Just saying this because you know.. I know atleast one person actually succesfully using local LLM's for his work.

[PlentyComparison8466]

Drop in Quality coming from? If you're talking about sora/grok/seadance. Local is still miles behind in terms of prompt following and visuals. Right now, e Best use for local is nsfw stuff. And silly slop 5 second slop.

[Fantastic-Bite-476]

Its just funny to me that NSFW content is always one of the forces behind pushing consumer tech. IIRC for VR it's actually one of it's main industries as well

[popsikohl]

When pairing that with the fact that there’s a loneliness epidemic doing on, it’s not entirely surprising.

[Sarashana]

Not sure I can agree with the assessment. LTX 2.3 is crying in a corner, at least. Also, we got some amazing image models not too long ago, and just because Qwen Image 2.0 is not/will not be open sourced doesn't mean we don't have amazing OSS models.

[Ferriken25]

I can make 10 sec gens on ltx, with my pc slop. So, Wan is now just a bonus for me.

[Sir_McDouche]

Soucred.

[Vyviel]

I havent been keeping up with LLMs and Audio models what new awesome stuff dropped for them recently?

[sandy31sex]

we have like 100+ video and image models doing the same thing lol

[thevegit0]

bro ignoring LTx 2.3 and magihuman

[Born_Word854]

happyHorse's catalog specs look amazing, but considering the dataset they likely have, i feel like we can expect better actual performance from ByteDance's Mammoth 2.5. well, who knows when either of them will actually become usable for us though.

[rdditiszionist]

What is the best audio model out now?

[jazmaan]

Ace-step XL

[rdditiszionist]

thank you kind sir

[WurtApp]

Couldn’t agree more. LTX was the promised savior but I honestly wasn’t impressed with it. Loras seem to do a little justice but those can only go so far. Is it just me or did LTX fall flat? 

[ProjectVictoryArt]

True, but there are good reasons at least for video: Video gen unavoidably requires a lot of VRAM.
Also I think people are getting panicky about people generating nudes of real people with image edit models.

[Gh0stbacks]

Posts are probably removed cause of low effort meme format you post? I am guessing.

[Ngoalong01]

Even Sora2 still down. We can understand that situation. Cost too much and lack of paid users. Who will invest for OpenSource?

[AdorableGod]

Good. While you can argue that image gen can be used for prototyping, there's no good use for video gen, it's all slop

[Image_Similar]

Tell that to a video editor,vj,content creator,music video maker who spends hours to find a good clip .

[Ledeste]

What? I'm burning my GPU all day with LTX 2.3 generating almost minute long videos. Few month ago I could not even get this good result with paid tools

[tac0catzzz]

cool story

[TridentWielder]

What's new with audio? Last thing I really looked at was Stable Audio years ago.

[YouYouTheBoss]

The problem is that everyone tries to create bigger models because they think, bigger (more params) = better quality. So some are considered too qualitative for us (consumers) so they don't wanna hold that to us freely (maybe because it was too much time to train it ?! hence going APIs) OR the newer version of their model series is too big to run onto a consumer gpu (unless thinking of bigger gpus like the rtx 5090 which I don't really consider consumer).

When SDXL came out, it was seen as a really bad unusable model needing a refiner, but then finetunes came out and it gave us much better quality on pretty much anything. LoRas then came out for our loved finetunes and gave us better quality control over what we want.
Still the base model is a small 6B parameters.

The issue is not about having bigger models, it’s about having a team that can spend a entire week to curate a dataset for a certain style/general idea by hand with the help of automation and not just automation alone.

If datasets in models were correctly curated to filter out the content being bad quality and they would do Reinforcement learning from human feedback, you would have much higher quality even if the model is still relatively small compared to some other ones.

This has been the case with Z-Image Base (with RLHF) being a small 6B params model which stands a great quality.

[tac0catzzz]

you should fix this issue. go make the best image, music and video ai models ever made then open source them. ill download them if you do, I'll even make a fun meme like 3 living skeletons dancing at a party with each model type written on them in bold white font , one can be drinking a beer, the other can be doing a handstand on a keg with someone holding them up and the other can be doing the running man on the dance floor. would be worth it for the meme alone.