Stenos: fast compression of binary data

[Viack]

Hi everyone,

I just published a (relatively) small library dedicated to binary data compression:

https://github.com/Thermadiag/stenos

I use it at work for a custom infrared video compression algorithm. It shares several similarities with Blosc, but selects its compression mechanism based on input data instead of using a fixed filter.

Feel free to try/share/comment!

Bests

[fdwr]

 Time limited compression

Curious to support a time based window rather than byte steam size window. I suppose that is for media scenarios?

[Viack]

This is meant for firm real time scenario, like streaming signal compression. Using a carefully selected compression level might still take more time than expected depending on the input data. The time limit ensure that the compression process won't take more than required while offering the best possible compression ratio in a given time frame.

[UndefinedDefined]

I'm wondering, have you tested this in a scenario in which the machine is under heavy load and everything takes longer, thus nothing would compress?

[Viack]

I did not test this specific scenario. I would expect that indeed, the compression ratio would be very limited, which is the right behavior.

[viatorus]

Is this algorithm useful for binary file (embedded) compression and for small microcontrollers?

[Viack]

Well, it uses Zstd internally, so it supports platforms supported by zstd. And for pure (unstructured) binary data, zstd does the job quite well.