there's a lot that's interesting about this, def worth a read, but I still have questions https://www.confluent.io/blog/publishing-apache-kafka-new-york-times/ …
-
Show this thread
-
using something like an append-only model (or even `ORDER BY entry_date` with indices), couldn't you create such a stream in an RDBMS?
1 reply 0 retweets 0 likesShow this thread -
you could give each consumer a read-only user connection/credentials? then instead of Stream API, you could use good-ole-fashioned SQL?
1 reply 0 retweets 0 likesShow this thread -
the "downsides of DB" seem avoidable: schema flexibility? JSONB or HSTORE streaming changes? clients also use append-only for their stores
1 reply 0 retweets 0 likesShow this thread -
it's novel and I did a similar model for analytics processing at a prev company. and they obv know their problems data better than I do
1 reply 0 retweets 0 likesShow this thread -
Replying to @SrPablo
immediate take: it seems like the appeal of this set up would be to lean on the Kafka APIs/libs a bit more than RDBMS + writing your own
1 reply 0 retweets 1 like
(and of course, outside support available)
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.