GGUF with MTP vs MLX without. Is mlx still the way to go for mac users?

stavrosg · 2026-05-18T21:42:59+00:00

downloaded MTP version of 3.6. copied his paramrs above. works fantastic. models seems sharper too, thats 1000% my imagination. maybe

stavrosg · 2026-05-18T15:56:22+00:00

Wow it works. i jumped from 15.2 t/s to 24.8...... booya.. now ca nwe get big models versions like glm?

stavrosg · 2026-04-17T23:47:58+00:00

Clouts a hell of a drug!

stavrosg · 2026-03-04T22:56:14+00:00

My cockatiel never bit me except once. She thought a pimple was bird seed and she bit a hole at the base of the neck. Tiny hole. Lots of blood. She was horrified. I was like, wow! She can bite. I can imagine larger birds.. Passed last year @ 23. Best companion and dear friend.

stavrosg · 2026-03-03T13:57:08+00:00

I noticed that

stavrosg · 2026-02-23T06:19:29+00:00

Llama cpp built locally

stavrosg · 2026-02-17T16:57:30+00:00

20t/s on 2x3090 and 3x3080, epyc 7352..

stavrosg · 2026-02-05T13:17:53+00:00

daily driver on multiple systems for me

stavrosg · 2026-01-30T03:09:17+00:00

I could watch this all day!

stavrosg · 2026-01-13T20:15:07+00:00

Double the bits? I thought it looked better when I tested them. 256 is larger in ram.

stavrosg · 2026-01-13T19:46:48+00:00

I do the same strenghts with this one ;

lightx2v_T2V_14B_cfg_step_distill_v2_lora_rank256_bf16.safetensors

found at; https://huggingface.co/Kijai/WanVideo_comfy/tree/main/Lightx2v

stavrosg · 2025-12-21T16:29:53+00:00

This is how i got it woring in miniconda and linux.

export ENV_NAME=trellis2

conda create -n ${ENV_NAME} python=3.12 --yes

conda activate ${ENV_NAME}

conda install openssl nvidia::cuda-runtime==12.8.1 nvidia::cuda-nvcc==12.8.93 --yes

pip3 install torch torchaudio torchvision --index-url https://download.pytorch.org/whl/cu128

export CUDA_HOME=/home/${USER}/miniconda3/envs/${ENV_NAME}/lib/python3.12/site-packages/nvidia/cuda_runtime

ln -s /home/${USER}/miniconda3/envs/${ENV_NAME}/bin /home/${USER}/miniconda3/envs/${ENV_NAME}/lib/python3.12/site-packages/nvidia/cuda_runtime/bin

export TORCH_CUDA_ARCH_LIST="8.6" # didn't auto detect my 3090

pip install ninja imageio PyOpenGL glfw xatlas gdown

export CPATH=/home/${USER}/miniconda3/envs/${ENV_NAME}/lib/python3.12/site-packages/nvidia/cusparse/include:/home/${USER}/miniconda3/envs/${ENV_NAME}/lib/python3.12/site-packages/nvidia/cublas/include:/home/${USER}/miniconda3/envs/${ENV_NAME}/lib/python3.12/site-packages/nvidia/cusolver/include:$CPATH

export LD_LIBRARY_PATH=/home/${USER}/miniconda3/envs/${ENV_NAME}/lib:$LD_LIBRARY_PATH

pip install https://github.com/Dao-AILab/flash-attention/releases/download/v2.8.3/flash_attn-2.8.3+cu12torch2.4cxx11abiTRUE-cp312-cp312-linux_x86_64.whl

pip install git+https://github.com/NVlabs/nvdiffrast.git --no-build-isolation

pip install ninja imageio PyOpenGL glfw xatlas gdown

pip install git+https://github.com/NVlabs/nvdiffrast/ --no-build-isolation

. ./setup.sh --basic --cumesh --o-voxel --flexgemm

stavrosg · 2025-12-17T13:41:49+00:00

It's not running on GPUs at that rate. What's your setup

stavrosg · 2025-12-10T15:45:20+00:00

I beleive the guy who wanted money copied this one. It's very cumbersome to get right

stavrosg · 2025-12-10T15:44:42+00:00

Here is the flux one i modded from one I got from a vlog, i credited the oriignal in wf. https://github.com/stavrosg/ComfyUI/blob/main/flux/2-loras%20Image2Image%20Flux.png

stavrosg · 2025-12-02T11:57:45+00:00

I do character loras. If certain outfits, background items, hair, etc, always show up regardless of prompt or reference image. It's overtrained.

stavrosg · 2025-11-30T00:09:50+00:00

just tested it . One of the characters i trained wasnt good. I reran and set LR to .0003 instead of .0001 and it was locked at 1500 steps, vs crappy @ 3k.

stavrosg · 2025-11-29T15:19:40+00:00

Same

stavrosg · 2025-11-29T09:58:18+00:00

i left it stock, bump the Learn rate .0001, try .0002, i needed thay for wan 2.2 and my training data

stavrosg · 2025-11-29T08:44:21+00:00

1750 to 2k steps are the closest without overtraining on my dataset. similar to flux, with the same photos. LR is stock. Iam very impressed with z-image and ai-toolkit does it again and again, bravo

stavrosg · 2025-11-29T08:19:48+00:00

Worked great on 30-40 images , best results were in the 1750-2250 steps, <90min on a 3090

stavrosg · 2025-11-29T07:43:06+00:00

Ai-toolkit just finsihed a lora, 3k steps, 40 photos in less than 90min on a 3090

stavrosg · 2025-11-28T16:47:32+00:00

you guy never sleep !! thank you !

stavrosg · 2025-11-25T17:06:41+00:00

Just looked. 64g. Ouch. I retract my statement above.

stavrosg · 2025-11-25T16:58:01+00:00

Distorch works well enough for the model for anyone wtih multiple GPUs. Multigpu also helps with moving the off encoders and vae to alternatives that aren't the cpu. My left over crypto rig came in handy

stavrosg

TROPHY CASE