Are there any open source services for managing zstd dictionaries? ie: training, fetching, versioning, testing, etc?
Conversation
Replying to
Lack of decent tooling and standards is why there's still no usage for HTTP compression. Brotli having a standard dictionary that's used by default means almost everyone is using that. zstd not having one means hardly anyone bothers doing it since you need to generate them.
I don't think there's really a better way of dealing with it than scripting it yourself and managing the inputs for generating dictionaries in git where you need to handle versioning, etc. yourself. We might switch to zstd from DEFLATE for Auditor QR codes at some point.
1
Considered using github.com/vkrasnov/dicta to replace simply concatenating a few samples together for a pre-shared DEFLATE dictionary but it's too much trouble to get a bunch of samples and then update them all and generate a new dictionary. The dumb approach worked too well.
1
Show replies