Data Driven Action: a primer on Data Science
summary
Pipeline shows how to go from raw streams to actions: ingest with Spring XD into HDFS, queue with RabbitMQ, tag tweets with Ocktweet NLP via PL/Java, extract phrase polarities and score 55 million tweets a day for sentiment, and run distributed models with Madlib + Greenplum (streaming linear regression, logistic failure classifiers, VAR time‑series). A server‑room prototype uses USB/Arduino sensors, Redis caching, batch retrain plus real‑time scoring, alerts on divergence, and a dashboard on Cloud Foundry — the components scale and the demos prove the approach.
AI-written summary · about
chapters (5)
- 0:00Introduction to data science
- 1:17Streaming sensor data
- 8:52Predictive modeling use cases
- 31:33NLP for sentiment analysis
- 1:01:20Real-time monitoring framework
related talks
52m100% Big Data. 0% Hadoop. 0% Java.
37mBig Data Analytics, Machine Learning, Real Time Processing
38mRealtime Data Activation - Analytics, Intelligence & Decision Making
01h 47mRadanalytics.io streaming applications workshop
52mDevil in the Haystack
30mSmart Streams: A Real-time framework for scoring Big and Fast Data
01h 35mDeep Dive into the Big Data Landscape
11mData Science and Smart Systems: Creating the Digital Brain