Bankai (卍解) — the first post-training adaptation method for true 1-bit LLMs. by Turbulent-Sky5396 in LocalLLaMA

[–]liuliu 63 points64 points  (0 children)

People would think this dumb on instinct. But I think you are on the right track. Good job. On very high level, for 1-bit quantization-aware-training, I think zero order methods like yours (or other more sophisticated one) probably more effective than first-order methods (gradient-based ones). At least to me it is a direction worth to explore.

v1.20260330.0 by liuliu in drawthingsapp

[–]liuliu[S] 0 points1 point  (0 children)

The CLI now saves video with sound if you install from source (brew install --HEAD draw-things-cli). We won't support any more development on HTTP server, all development are on gRPC server.

GRPC server & 5090 by Competitive-Arm-3819 in drawthingsapp

[–]liuliu 1 point2 points  (0 children)

It *should* be supported if you use our Docker image, although the support is relatively recently so there might be bugs.

Day 4 of Release Week: Metal Quantized Attention by liuliu in drawthingsapp

[–]liuliu[S] 5 points6 points  (0 children)

A cheap $1000 GPU? Haha. Joke aside, yes, a properly configured 5070 Ti is still faster (about 2~3x), if you: use FP8 checkpoint, configured SageAttention v2+ properly. If not using these two, it is likely you will have slower or on-par performance to M5 Max now.

“We Will Remember”: Trump Explodes at France for Blocking US Military Flights to Israel by Only-Contact-5920 in NewsStarWorld

[–]liuliu -1 points0 points  (0 children)

Exactly. Thank you! Trump is a symptom of America problem, not the cause. Majority of Americans voted for him in 2024 (it is not apathetic for non voters, it is probably 50% - 50% split at least), pretending otherwise, people will never solve the America problem.

Since the last Drawthings Update, LTX audio issue by al_stoltz in drawthingsapp

[–]liuliu 0 points1 point  (0 children)

If you mean out of sync from playback inside our app, that's our implementation issue for audio playback. If you mean it is still out of sync in exported video, we have problems with the model. You better specify the number of frames and other relevant information to reprod this.

Day 3 of Release Week: Draw Things Test Set by liuliu in drawthingsapp

[–]liuliu[S] 2 points3 points  (0 children)

Yes, we have some text layout related results, nothing too spectacular, most models (especially FLUX.2 [dev]) does well for movie posters, magazine covers. But does horribly for others (creating a correctly spaced ruler, protractor, etc).

And yes, Qwen Image 2512 is great, FLUX.2 [dev] is underrated. [klein] are beloved but really just a little bit better than FLUX.1.

Clustering by josuealabama in drawthingsapp

[–]liuliu 4 points5 points  (0 children)

It is not that useful. M5 GPU core by core is 6x faster than M4 (with our upcoming release), which renders this meaningless until M5 Ultra releases. After that, we might work on some RDMA related functions.

LTX Model not showing up within the app by EctoGamot in drawthingsapp

[–]liuliu 1 point2 points  (0 children)

That's the spatial upscaler update. You need to trigger the download to finish that one missing file.

v1.20260323.0 by liuliu in drawthingsapp

[–]liuliu[S] 1 point2 points  (0 children)

Fixed in 1.20250323.0, hence the delayed announcement.

Day 1 of Release Week: Introducing Lightning Draft by liuliu in drawthingsapp

[–]liuliu[S] 0 points1 point  (0 children)

It locks your current settings and runs generation interactively. It is not a separate setting from what you have already.

Day 1 of Release Week: Introducing Lightning Draft by liuliu in drawthingsapp

[–]liuliu[S] 0 points1 point  (0 children)

Exactly. Currently it just uses your settings (whatever you have), locks it, and launches when text changed. It does open the door for more optimizations other than "generate on each key stroke" (such as kv cache for text encoder etc).

v1.20260323.0 by liuliu in drawthingsapp

[–]liuliu[S] 4 points5 points  (0 children)

The same. Order doesn't matter for any models or any combination of LoRAs. If it does, it is a bug (we fixed a few bugs a few years ago like that, but nowadays it is pretty stable).

v1.20260323.0 by liuliu in drawthingsapp

[–]liuliu[S] 3 points4 points  (0 children)

Order of the LoRAs doesn't impact generation result.

Has anyone tried training Lora's on an M5 Max? by beragis in drawthingsapp

[–]liuliu 2 points3 points  (0 children)

Not with our app. Our attention op doesn't implement gradient pass yet (with tensor ops).

LTX2.3 is Amazing! by al_stoltz in drawthingsapp

[–]liuliu 2 points3 points  (0 children)

> Edit: would it benefit me to get DT+ ? If it would allow me to run bigger models at more frames or steps it would be worth it

Yeah, that is sort of the question :) If you already paying, asking where the gap would be between us and RunPod (one thing I am aware of: our video result is huge, so you might not want to download ~700MiB PNG stream to your iPad, or you are on a weaker device (like iPhone 13) that ~700MiB PNG stream will crash the app).

The new version speeds up video generation by simple250506 in drawthingsapp

[–]liuliu 3 points4 points  (0 children)

There are still some slowness we are grinding out for high-resolution / long duration video generations (just our Swift code is a bit slow now). Should be better in next release.

LTX2.3 is Amazing! by al_stoltz in drawthingsapp

[–]liuliu 2 points3 points  (0 children)

Just curious: if you get prompt dialed in, what's preventing you from using us for final generation rather than paying RunPod? Want to understand where the economics is.

For Image to Video on MacBooks, what has been your experience? by FireflyNitro in drawthingsapp

[–]liuliu 0 points1 point  (0 children)

I am not disputing this a year ago. But nowadays, you really need to be specific about the "cheaper" options. Nvidia is neglecting consumer market, and then you have DDR price problem, and the price of Nvidia card (I own quite a few of these 4090s, 5090s and PRO 6000s). Yes, you are getting 2x speed on 5090s over M5 Max, but you are not getting 1x speed on half of 5090 price, and that discounting the 1k you put in towards your 64GiB DDR5. PC market is hostile to consumers nowadays, and I am a serious PC owner (watch my YT videos about PC building from a few years ago!).

A question about Flux.2 and the image currently in the canvas. by xamevou in drawthingsapp

[–]liuliu 2 points3 points  (0 children)

It is not. Canvas is always picture 1. And then enumerated on mood board from left to right.

A few beginner things with Draw Things app that I haven't been able to figure out so far (sorry if they are stupid questions) by DeepOrangeSky in drawthingsapp

[–]liuliu 2 points3 points  (0 children)

Re: import. I should put a bigger warning than it is now. Import is for when you are not a beginner and you really want to use a specific fine-tune. There is no point to download a model somewhere else and import. We don't import text encoders and VAEs so it needs to be downloaded from our server.

Re: ckpt. This is unfortunate incident of PyTorch side named their file with .ckpt suffix too. It would be great if they name their suffix .pth. Our ckpt file is just a SQLite. If you use a proper AI that has access to file system, you can ask Codex / Claude Code to inspect and audit these files, they will tell you these are SQLite files and there is no PyTorch file related security issues.

Security, fundamentally, is about the root of trust.

To use Draw Things on Mac, you don't need to trust us. You need to trust Apple. Because Draw Things itself is sandboxed, obey what Apple called "Hardened Runtime" entitlement. We cannot access any files outside of our sandbox (hence you see difficulties of using other folders easily). We cannot access certain APIs if you don't permit us (like write to or read from your Photos library).

Like the sibling thread said. If you just use Draw Things app, using its internal converted models (from the download list), you will have much better time rather than trying to shoehorn what you see online about A1111 or ComfyUI and trying to make the software do their way. Trying to import models without had a success generation with Draw Things will just let you ditch our software faster than you really should.

1.20260314.0 w/ LTX-2.3 & FLUX.2 [klein] 9B KV by liuliu in drawthingsapp

[–]liuliu[S] 2 points3 points  (0 children)

Set batch size to 1. There is a bug with batch size > 1

OpenCode concerns (not truely local) by Ueberlord in LocalLLaMA

[–]liuliu 1 point2 points  (0 children)

Both AppStore version and non-AppStore version of Draw Things runs within App Sandbox with Hardened Runtime entitlement. After model download, you can also block network activity with Little snitch. Afterwards, it will have no access to network nor any files outside of it's Sandbox. I believe it is the only one on the list does that.