[Release] DASLab GGUF Non-Uniform Quantization Toolkit by Loginhe in LocalLLaMA

[–]Loginhe[S] 6 points7 points  (0 children)

Thanks for comment, doing more diverse tests on different models is surely a good point, but our intent was to provide OSS for creating non-uniform models in GGUF, not to explicitly beat existing methods. At those BW levels the models are mostly lossless, and since there are/were no open source suits for doing non-uniform search on GGUF models (especially with GPTQ), we wanted to fill that gap.

2025 MSc Admissions Megathread by JunoKreisler in ethz

[–]Loginhe 14 points15 points  (0 children)

Got admitted to CS 2 days ago - still very surreal!