Can you describe the tech stack you're moving towards with push shift (not looking for proprietary info)? I'm researching large data storage formats. My project can generate a ton of data, and we're not going to be able to scale it.
Conversation
Replying to
Currently using Elasticsearch (heavily) on the backend. The two primary DBs we use are Postgres (scaling via Citus) and Elasticsearch.
Does that help at all?
Replying to
Yes it does. I think for our use case that's not the direction we're going, but I appreciate the info! :)
1