Does anyone know what happens with a compressed file (specifically zstandard) if there is a bit flip in the file? Does it cause garbage decompression after that point? How tolerant is Zstandard with bit-rot? Might be worth exploring considering I have 250 TB compressed now.
Conversation
Replying to
I have multiple copies currently, but this is something I'm going to need to eventually figure out for long-term archival.
1
1
Replying to
I don’t know zstandard, but I’d 1) flip a bit and check, and 2) see if there is an integrity check option.
1
Replying to
By default, there's a 32-bit checksum at the end of each frame created by the `zstd` cli
2
1
5
Show replies
This Tweet is from an account that no longer exists. Learn more
