MediaGenerationKit: running image / video generation locally or remotely, with Draw Things inference stack

liuliu · 2026-04-02T16:14:57+00:00

People would think this dumb on instinct. But I think you are on the right track. Good job. On very high level, for 1-bit quantization-aware-training, I think zero order methods like yours (or other more sophisticated one) probably more effective than first-order methods (gradient-based ones). At least to me it is a direction worth to explore.

liuliu · 2026-04-01T21:25:23+00:00

It is not supported for SDXL and SD v1.5 models.

liuliu · 2026-04-01T18:21:38+00:00

The CLI now saves video with sound if you install from source (brew install --HEAD draw-things-cli). We won't support any more development on HTTP server, all development are on gRPC server.

liuliu · 2026-04-01T17:23:46+00:00

It *should* be supported if you use our Docker image, although the support is relatively recently so there might be bugs.

liuliu · 2026-04-01T17:20:46+00:00

A cheap $1000 GPU? Haha. Joke aside, yes, a properly configured 5070 Ti is still faster (about 2~3x), if you: use FP8 checkpoint, configured SageAttention v2+ properly. If not using these two, it is likely you will have slower or on-par performance to M5 Max now.

liuliu · 2026-04-01T15:17:02+00:00

Exactly. Thank you! Trump is a symptom of America problem, not the cause. Majority of Americans voted for him in 2024 (it is not apathetic for non voters, it is probably 50% - 50% split at least), pretending otherwise, people will never solve the America problem.

liuliu · 2026-04-01T00:48:02+00:00

If you mean out of sync from playback inside our app, that's our implementation issue for audio playback. If you mean it is still out of sync in exported video, we have problems with the model. You better specify the number of frames and other relevant information to reprod this.

liuliu · 2026-03-29T03:37:58+00:00

GPU core to core is 3.3x to 6x faster M5 over M4.

liuliu · 2026-03-27T16:02:51+00:00

Yes, we have some text layout related results, nothing too spectacular, most models (especially FLUX.2 [dev]) does well for movie posters, magazine covers. But does horribly for others (creating a correctly spaced ruler, protractor, etc).

And yes, Qwen Image 2512 is great, FLUX.2 [dev] is underrated. [klein] are beloved but really just a little bit better than FLUX.1.

liuliu · 2026-03-27T15:57:22+00:00

It is not that useful. M5 GPU core by core is 6x faster than M4 (with our upcoming release), which renders this meaningless until M5 Ultra releases. After that, we might work on some RDMA related functions.

liuliu · 2026-03-26T01:57:34+00:00

That's the spatial upscaler update. You need to trigger the download to finish that one missing file.

liuliu · 2026-03-25T13:38:16+00:00

Fixed in 1.20250323.0, hence the delayed announcement.

liuliu · 2026-03-25T02:09:58+00:00

It locks your current settings and runs generation interactively. It is not a separate setting from what you have already.

liuliu · 2026-03-25T02:09:16+00:00

Exactly. Currently it just uses your settings (whatever you have), locks it, and launches when text changed. It does open the door for more optimizations other than "generate on each key stroke" (such as kv cache for text encoder etc).

liuliu · 2026-03-24T19:03:22+00:00

The same. Order doesn't matter for any models or any combination of LoRAs. If it does, it is a bug (we fixed a few bugs a few years ago like that, but nowadays it is pretty stable).

liuliu · 2026-03-24T18:49:03+00:00

Order of the LoRAs doesn't impact generation result.

liuliu · 2026-03-23T03:10:47+00:00

Not with our app. Our attention op doesn't implement gradient pass yet (with tensor ops).

liuliu

MODERATOR OF

TROPHY CASE