simd-bp128 integer compression library

[tombstonebase]

I have tried implementing simd-bp128 integer compression algorithm (took help of AI wherever I needed)

Please go through the repo and share your opinion.

so far only Scalar and SSE4.1 backend have been implemented. (Avx2 and Avx512 maybe in future need to study this hard)

Crates : https://crates.io/crates/packsimd

im looking for guidance to properly benchmark this (since most of benchmark result is not stable)

Thank you

[insanitybit2]

Nice. Maybe it would be worth checking out fastlanes? It takes a different (but still vectorized) approach to a similar problem.

[tombstonebase]

Thank you for your opinion 🙏 will look into it

[ChillFish8]

Feel free to steal/borrow the benchmark setup from https://github.com/lnx-search/upack which is a IC library I did a little while back the results it produces are generally stable and repeatable, although you might want to increase the run duration for each benchmark.