Pcodec

Latest version: v0.3.0

Safety actively analyzes 675360 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 3

0.0.0

* Improved decompression performance ~70% on aarch64, ~10% on x86_64.
* Supported consuming any `BetterBufRead` implementation during decompression, rather than only `&[u8]`
* Changed the API for `wrapped::PageDecompressor` and `standalone::ChunkDecompressor` to own `src`, since these parts of the file need to be read in order and contiguously.
* Updated docs, including real-world benchmarks on air quality, taxi, and r/place datasets.

0.0.0alpha.3

With lower-level unit testing, found and fixed 3 serious bugs:

* encoding more than one page per chunk failed; it tried to encode the whole chunk every time
* decoding one batch at a time failed because the code path asserted the reader would be byte aligned
* decoding with most limits through the CLI failed because it create a bad count of numbers for pco

0.0.0alpha.2

* Revamped the API into separate structs for File, Chunk, and Page compressors/decompressors.
* Fixed a known bug that caused panics for 32-bit architectures.
* Made decompression almost-zero-copy, increasing performance slightly.
* Made standalone actually just a minimal wrapped format with no access to private functionality.

0.0.0alpha.1

Changed the format to contain tiny batches (256 numbers each) with contiguous 4-way interleaved tANS codes and contiguous offsets. This increased the buffer space needed, but allowed decent CPU utilization during tANS decoding and excellent SIMD utilization during offset decoding, approximately a 30% decompression speedup overall.

0.0.0alpha.0

Unveiling the alpha of pco (the library) and pco_cli (the binary) for pcodec, a new format and codec for compressing numerical sequences. Its API is very similar to that of q_compress, but its compression ratios and decompression speeds are much better.

Page 3 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.