A modern compression tool
Modern Compression
The chief fault of zstd
is that its advanced options are lightly documented and are only immediately useful to Python experts. However, even at the most basic level, zstd
challenges traditional compression commands. While zstd
does offer some compatibility with older commands, as well as using tar
as a tool, it is at least as fast as older commands for compression and noticeably faster in decompression – just how much faster depends on options and file types.
Happily, although you need to experiment with settings if you want to squeeze the utmost efficiency out of zstd
, the defaults are often sufficient for most purposes. Supporting legacy compression commands while developing its own perspectives, zstd
is typical of the modern replacement commands that are becoming more common in Linux. As zstd
matures, its documentaton should improve and the last barriers to its popularity should fall.
Infos
- zstd: https://github.com/facebook/zstd/blob/dev/doc/zstd_compression_format.md
- LZ77: https://en.wikipedia.org/wiki/LZ77_and_LZ78
- Entropy encoders: https://fastcompression.blogspot.com/2013/12/finite-state-entropy-new-breed-of.html
- Sample dictionary: https://github.com/facebook/zstd/blob/release/lib/zdict.h
- Industry standard: https://github.com/facebook/zstd/blob/dev/doc/zstd_compression_format.md
- Third-party dictionary guidelines: https://rdrr.io/cran/zstdr/f/src/third_party/zstd-1.2.0/programs/README.md
« Previous 1 2
Buy this article as PDF
(incl. VAT)