Cassandra is supposed to be blisteringly fast for writes. My 25mil record insert is still running from overnight. So, yea...this learning curve will be steper than I want. (Actually, I think it's the python client that's slow?)
-
Show this thread
-
Replying to @generativist
Do they have a command line import tool maybe for doing the initial data dump? I had a similar thing with
@neo4j. Projected time to insert the data via python was a week. Via the importer tool, 1 minute.1 reply 0 retweets 1 like
Oh yea I tried CSV: blazing fast :) The issue was the python driver. I had to run it with (built in) multiprocessing to make it go faster.
9:35 AM - 19 Sep 2019
0 replies
0 retweets
1 like
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.