Open Source Social Applications with Apache Streams
summary
Apache Streams normalizes social exports to Activity Streams 2.0 and provides Java/Scala connectors for Twitter, Facebook, Instagram; the demo runs Flink and Spark inside Zeppelin to pull 272 posts and enumerate 2,566 profiles, handles API rate limits, ingests Twitter archives to bypass timeline limits, writes JSONL into Postgres, and serves data via a React Admin UI with SQL and embedded HTTP APIs in Docker. Probot is an OSS single‑user app for browsing, filtering, mass actions; roadmap adds OAuth, multi‑user support, JSON‑LD/RDF and graph backends.
AI-written summary · about
chapters (12)
- 0:00Introduction to talk
- 0:52Apache Streams overview
- 3:08Activity Streams specification
- 8:07Introducing Probot project
- 11:21Live demo setup
- 13:08Data collection process
- 23:38Data processing and loading
- 26:58Probot UI walkthrough
- 29:23Handling data archives
- 31:49Probot roadmap
- 34:17Apache Streams roadmap
- 36:23Q&A session
related talks
28mSweet Streams Are Made Of These
50mApplication development and data in the emerging world ...
47mBuilding Modern Data Streaming Apps with Open Source
45mApplications in the Emerging World of Stream Processing
38mBuild your own social media analytics with Apache Kafka
49mscale.bythebay.io: Stephan Ewen, Apache Flink and the Next Wave of Stream Processing Applications
40mEvent Streaming Applications with Kafka Streams, Spring Kafka and Actuator
38mApache Flink: A Very Quick Guide