Conversation

Flatten a Tweet If you have a json object and want to completely flatten it (perhaps as a first step towards a CSV dump), the following works well: cat tweet.json | jq '. as $in | reduce leaf_paths as $path ({};. + { ($path | map(tostring) | join(".")): $in | getpath($path) })'

JSON Baumgartner

@jasonbaumgartne

Aug 15, 2020

This command should output as CSV after flattening. cat tweet.json | jq -r '. as $in | reduce leaf_paths as $path ({};. + { ($path | map(tostring) | join(".")): $in | getpath($path) }) | [.[]] |

Replying to

and

jq accepts filename(s) as arguments(s) making the pipe from cat superfluous.

Replying to

and

Or maybe you use an old version which didn't, in which case I shut up

Igor Brigadir

@igor@mastodon.social

Replying to

and

jq doesn't read compressed files directly - so one advantage of piping in is you can read from super compressed files like: zstd -d big.zstd | jq --stream ...

Replying to

and

Indeed, but Jason's example isn't of a compressed file. One could also pass the decompressed stream as an arg using $(zstd -d file.zst) or even backticks I suppose

Replying to

and

I used cat to show an example of piping it in (since most people will decompress and pipe straight from compressed files). It is superfluous but it was mainly used to illustrate how to accept input from something through pipes.

6:39 PM · Aug 15, 2020Twitter Web App