Wednesday, September 07, 2022

Run lz4 compression in parallel using GNU parallel

I like compressing my SQLite DB as separate lz4 files. I use the below commands to compress them in parallel using the lz4 utility.
parallel lz4 -12 -m ::: *.db
You can install GNU parallel on Ubuntu using the below command
sudo apt install parallel
Note: Passing -m option to the lz4 utility is essential to avoid stdout outputs.

No comments: