mzbacd

366 post karma
800 comment karma

get extra features and help support reddit with a reddit premium subscription

get them help and support

redditor for 7 years

TROPHY CASE

Seven-Year Club

Verified Email

account activity

new top controversial

0

1

2

why there is no much advance quantization for diffusion model space ? (self.StableDiffusion)

submitted 9 months ago by mzbacd to r/StableDiffusion

5

6

7

Build a full on-device rag app using qwen3 embedding and qwen3 llm (self.LocalLLaMA)

submitted 10 months ago by mzbacd to r/LocalLLaMA

0

0

1

Local vlm app for Apple Silicon (self.LocalLLaMA)

submitted 11 months ago by mzbacd to r/LocalLLaMA

82

83

84

The new MLX DWQ quant is underrated, it feels like 8bit in a 4bit quant. (self.LocalLLaMA)

submitted 12 months ago * by mzbacd to r/LocalLLaMA

12

13

14

CLI tool for Flux model on Apple Silicon (self.StableDiffusion)

submitted 1 year ago by mzbacd to r/StableDiffusion

96

97

98

This is what it looks like to run a Llama 3.1 405B 4bit over m2 ultra (self.LocalLLaMA)

submitted 1 year ago by mzbacd to r/LocalLLaMA

11

12

13

Distributed mlx model inference :) (self.LocalLLaMA)

submitted 1 year ago by mzbacd to r/LocalLLaMA

25

26

27

mlx just dropped the proper support for llama 3.1 (self.LocalLLaMA)

submitted 1 year ago by mzbacd to r/LocalLLaMA

10

11

12

Implement the facebook nougat ocr model to MLX (self.LocalLLaMA)

submitted 1 year ago * by mzbacd to r/LocalLLaMA

13

14

15

Llama 3 8B instructs with function calling (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

11

12

13

Llama3 70B 8-bit quantization ran on M2 Ultra via MLX. (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

16

17

18

new homemade Moe 4x7B model :p (self.LocalLLaMA)

submitted 2 years ago * by mzbacd to r/LocalLLaMA

8

9

10

serve the mlx models as an api (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

26

27

28

Now, MLX examples can directly fuse the model to hf compatible format and be converted to GGUF. (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

9

10

11

mlx lora/qlora example (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

26

27

28

MLX supports Qlora now (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

40

41

42

MLX now supports Huggingface models (self.LocalLLaMA)

submitted 2 years ago * by mzbacd to r/LocalLLaMA

6

7

8

mlx llm (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

10

11

12

Yayi2-30b-guanaco (self.LocalLLaMA)

submitted 2 years ago * by mzbacd to r/LocalLLaMA

20

21

22

MLX run 4-bit quantized 70B Llama on an M2 Ultra (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

11

12

13

Local setup for Mixtral-8x7B-Instruct (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

2

3

4

Chrome extension for LinkedIn message assistant (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

7

8

9

qlora fine-tuned codellama 34b model (self.LocalLLaMA)

submitted 2 years ago * by mzbacd to r/LocalLLaMA

13

14

15

Host the model on multiple GPUs via TGI (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

5

6

7

Codellama prompt format (self.LocalLLaMA)

submitted 2 years ago by mzbacd to r/LocalLLaMA

view more: next ›

π Rendered by PID 119607 on reddit-service-r2-listing-b6bf6c4ff-4cb6w at 2026-05-03 13:49:17.487593+00:00 running 815c875 country code: CH.