Don't miss the upcoming webinar: Building Real-Time Data Pipelines with a 3rd Generation Stream Processing Engine - sign up now!
Get it on Github

Twitter Cryptocurrency Sentiment Analysis

Tags:Machine LearningLive FeedStreamingWindowingAggregationIMDG StorageCustom SourceTwitterPipeline API

Tweet sentiment is analyzed in real-time to compute cryptocurrency popularity trends.

Tweets are streamed from Twitter and categorized by coin type (BTC, ETC, XRP, etc). Then, Natural-language processing (NLP) sentiment analysis is applied to each Tweet to calculate the sentiment score. This score indicates whether the Tweet has positive or negative sentiment. Custom Jet transformations using the Stanford NLP Machine Learning library is used to compute the sentiment score for each cryptocurrency. Jet aggregates scores from the last 30 seconds, last minute and last 5 minutes and prints the coin popularity table.

DAG Visualization

Output

Hazelcast Jet

Main Menu