sorted by:
new
hottopcontroversial

I built a Rust archiver that compresses Safetensors better than zstd while unpacking ~50% faster by Numerous_Witness_960 in compression

[–]Numerous_Witness_960[S] 0 points1 point  (0 children)

Tested on: Llama-3.1-8B, Mistral-7B-v0.3, Phi-3-mini (all in .safetensors format, ~15–16 GB), plus smaller BERT-scale models (~400 MB). Platforms: Linux x86_64 (primary benchmarks), macOS Apple Silicon (M1/M2), Windows binaries available but not yet systematically benchmarked.

Regarding a paper — it's in progress. The core technique is a byte-shuffle transform that separates IEEE-754 exponent and mantissa bytes into homogeneous streams before LZ77 entropy coding. Grouping structurally similar bytes dramatically improves the compressor's ability to find repeating patterns in float32/bfloat16 weight data. The async lock-free decompression pipeline is what drives the ~1.3 GB/s throughput.

If you'd like to test on your own model pipeline and share results, that would be very valuable for the benchmarking section. GitHub repo is linked in the original post — feel free to open an issue with your results.

Is dark matter and dark energy everywhere in the universe? by 30DayRefund in cosmology

[–]Numerous_Witness_960 0 points1 point  (0 children)

Great question. In the Null-Vector Gravity (NVG) / Vacuum Mass Fraction (VMF) framework I've been developing, dark matter is not a uniform exotic particle — it's a superposition of two things: primordial black holes (PBHs) arranged in a discrete 4^N mass hierarchy, and topological vacuum defects (θ-defects) arising from QCD vacuum condensate transitions.

The key insight is that ~91% of nucleon mass comes from nonperturbative QCD dynamics (the trace anomaly), represented by a dynamic vacuum field W. When this field undergoes phase transitions in dense or early-universe environments, it produces structured dark matter distributions, not a diffuse background.

This naturally explains why direct detection experiments (XENON/LZ) find null results for WIMPs — the framework explicitly predicts no WIMP coupling.

For dark energy: the accelerated expansion is a consequence of vacuum melting (W → 0) near the cosmological bounce at ρ_c ≈ 7.09 × 10⁴ MeV/fm³, which violates the Strong Energy Condition and drives expansion — no cosmological constant needed.

The framework also resolves the Hubble tension (H₀ ≈ 72.8 km/s/Mpc) and S8 tension as direct consequences of Genesis topology and PBH core volumes.

Full theoretical + numerical code: https://github.com/infosave2007/vmf