Some major projects underway to help research.
1) Tweetshift: Tweetshift is a product by that will offer full Twitter management capabilities including the ability to easily monitor specific twitter accounts, schedule jobs to do specific searches and utilize the
Conversation
Twitter stream API to constantly monitor specific keywords along with accounts. Tweetshift will offer data visualization and a dashboard to show graphs of the ingest along with the ability to run specific analysis against the data. Leveraging the power of Redis, PostgreSQL and
1
Elasticsearch, you will be able to run searches quickly against large amounts of data. The goal for Tweetshift is to put you in total control of Twitter data from the point of ingest until the point of running tests and analysis on that data. Along with Tweetshift, there will
Replying to
be another submodule that actively monitors the server -- showing performance metrics including disk IO, CPU usage, memory usage, etc. With a powerful dashboard to show you all aspects of the back-end of the system, you will be able to quickly determine where bottlenecks are
1
occurring and how to deal with those bottlenecks. Tweetshift will be able to scale up to billions of objects easily and help give you a complete overall picture of what data you have collected and give you the ability to use that data with powerful filters and search methods.
1