Lots of folks at doing real time streams to caches and the like, but what ever happened to automatic incremental materialized view maintenance? Does something genuinely simple exist for that sort of thing? I want to climb out of the tar pit.
-
-
Replying to @BrandonBloom
every serious impl is kept close to the vest as part of million-dollar BI platforms AFAICT
1 reply 0 retweets 4 likes -
Replying to @cemerick
Interesting. Is there some evidence of these things somewhere?
2 replies 0 retweets 0 likes -
Replying to @BrandonBloom @cemerick
there was a very good conj talk on some of this - a differential dataflow engine for streaming datalog queries over streaming inputs. gives you the tools to do incremental view maintenance. that talk and the backing MSR work is to Chas point the only public stuff I know of.
2 replies 0 retweets 3 likes -
I have not yet sat down with the rust server that was presented and played with it, but hard agree that tech will be a landscape changer when it goes big.
1 reply 0 retweets 0 likes -
If you comuacross a link, please share.
1 reply 0 retweets 0 likes -
will dig for em as I get started here.
1 reply 0 retweets 0 likes -
I think/hope this is what people above are referring to: https://github.com/frankmcsherry/timely-dataflow … https://github.com/frankmcsherry/differential-dataflow … https://github.com/ryzhyk/differential-datalog … https://github.com/comnik/declarative-dataflow … (not clear if the latter two are competitors or what) and cc
@frankmcsherry perhaps?2 replies 0 retweets 3 likes
Yes! Apparently I came across some of those before and forgot. Where's my memex?? This also comes to mind: https://github.com/salsa-rs/salsa . Exciting to see so much energy in the space.
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.