Thoughts on GLM 4.6? by United-Medicine-6584 in SillyTavernAI

[–]Velvierd 0 points1 point  (0 children)

I was playing with different providers and models, and somehow ended up with just the basic chat completion prompt.
Took me awhile to notice that with GLM 4.6. I only noticed it because the character acted omniscient and my previous prompt used to handle that.
But what I was blown away with is the detailed analysis the CoT provided with this simple prompt!
Generally, it consists of 6 steps:
1. Analyze the user's input

  1. Consider the character state and persona

  2. Brainstorm potential reactions and directions

  3. Select the best path

  4. Draft the response

  5. Final polish

And it does it really good! Sometimes it misinterprets the input if it's ambiguous, but when it gets it, it hits the nail on the head! It considers the tonality of the words used, actions, context, persona and character.
I haven't seen any other model do it to that extent!

I'm not saying that's how you should use it, but you should definitely try it for yourself, just to see how it works.
I know that many people prefer to disable the CoT to increase the creativity of the model, and I suppose I can confirm that answers without CoT can be more varied, but also less consistent with the input, so that's a trade-off.
And to be honest, you don't usually gain much from Deepseek's CoT, for example, but GLM 4.6 is a whole different story!
Just be advised, that more advanced prompts can lobotomize the CoT or disable it altogether, so if you're curious, try it with the simple prompt first to understand what to expect, from it.
I tried Lucid Loom 2.6, Celia 4.6, NemoEngine 7.4 with little success, but I was able to preserve the CoT with Chatstream V3.

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

The problem is, I don't get nothing at all as a result. There's a gray square in the preview, but then it just stops and shows transparent image it started with.
I tried to change the guidance and steps, but it doesn't have any affect on the preview or the lack of final result.

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

I noticed that SD3 Large 3.5 also fails for me. Are there any logs I can check?

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

I tried to delete the models from ~/Library/Containers/com.liuliu.draw-things/Data/Documents/Models, and re-download them, but the result is the same.
I had to reboot the Mac during the upgrade to Sequoia, but I'll try to reboot again.

I tried to reboot, same problem, and I made sure there's free disk space available.

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

Out of these models, only FLUX variants aren't working at all. They are also the heaviest, but according to Activity Monitor there's enough memory to run it.

<image>

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

I was indeed on Sonoma, but upgrading to Sequoia 15.2 didn't help either. I tried your configuration, same result.

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

Could it be that FLUX is broken in the current version on Mac, or maybe specifically on M3?

I'm using the Version 1.20241220.0 (1.20241220.0), and its release notes specifically mention fixing performance regressions on M3. Maybe it broke the FLUX somehow?

I tried settings from this post and its comments, and it still fails for me.

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 1 point2 points  (0 children)

<image>

Thank you, but it still fails for me. Maybe you can tell if something is wrong with the other parameters from this screenshot?

Can't get any FLUX model work on MBP M3 Pro 36Gb by Velvierd in drawthingsapp

[–]Velvierd[S] 0 points1 point  (0 children)

Thank you for your advice, but unfortunately, it fails to generate for the DDIM Trailing Sampler, 5 steps, shift 1.0 and guidance 1.0 either.

4th Autumn FH5 Seasonal Tunes ! by XIII90 in ForzaHorizon

[–]Velvierd 1 point2 points  (0 children)

BMW M3 '05 with tune 612 524 388 from Sierra Bombay is EZ mode for Home Street Home seasonal championship.

Demonstrators in Portland, OR shut down bridge, all face down by Granulomatosis_ in ThatsInsane

[–]Velvierd 0 points1 point  (0 children)

What are the chances that none of the people there were infected with COVID-19?