Are you still using gzip or bzip2? If backwards compatibility isn't a concern, there's hardly ever any argument for it. zstd totally outperforms them in speed and still compresses better. If size is your only relevant outcome use xz.
-
Show this thread
-
just had a situation: "there's a cronjob creating a tarball and it takes longer than it should". Changed from gzip to zstd: 7 seconds instead of 30.
5 replies 9 retweets 50 likesShow this thread -
Replying to @hanno @ivanristic
pigz for life (if you need to maintain gz support)
1 reply 0 retweets 2 likes -
I'm not so sure that you even need to qualify with "if you need to maintain gz support" In my completely unscientific test on one file on one machine I had handy, pigz is both faster and compresses just as well as gz.pic.twitter.com/iy8cZcMb61
1 reply 0 retweets 0 likes -
you probably wanted to say zstd at the end. but you're comparing single-threaded zstd with multithreaded gzip. there's pzstd which beats pigz easily.
1 reply 0 retweets 1 like -
Right. I meant to say as well as zstd. pzstd is probably nice, but perhaps less available to mere mortals.pic.twitter.com/dUgOmbhmHG
1 reply 0 retweets 0 likes -
it's part of the normal zstd package, it's just as available as normal zstd.
1 reply 0 retweets 1 like -
Indeed it does. Thanks. While the CPU usage was indeed more maxed out with pzstd, I'm still not seeing how it's better than pigz in my single test case of a large file I had around. Perhaps it's good in some scenarios, but I'm not seeing an obvious reason to use it vs. pigz.pic.twitter.com/VS6u4Y0XoA
1 reply 0 retweets 0 likes -
these numbers surprise me, because I *always* get much better perf. with zstd. is there a caching effect? try running each of these twice and only take the latter number.
1 reply 0 retweets 0 likes
¯\_(ツ)_/¯ Like I said, it's a very unscientific test. But I'm not convinced to switch based on it.pic.twitter.com/homXYrPh8x
-
-
0 seconds user/sys time is suspicious
0 replies 0 retweets 0 likesThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.