Building a real time...
summary
Proof-of-concept OSTMap collects live geotagged tweets, ingests them with Apache Flink, stores compact records in Apache Accumulo and supports full-text term lookups plus a per-day geo-temporal index built from geohashes. Server-side Accumulo iterators filter exact coordinates after range scans, frontend uses AngularJS/Leaflet with clustering to render many points, stream jobs emit one-minute language counts, and salting (hash-prefix) prevents hotspotting; most map queries return under one second on their cluster.
AI-written summary · about
chapters (5)
- 0:00Start
- 2:36Proof of concept - an important tool in the industry
- 9:52Walking skeleton
- 18:08Batch processing
- 25:52Add some time!
related talks
40mStreaming Geospatial Vector Data with Apache Projects
27mStream, Store, Visualize: Fast-Track Real-Time Analytics the OSS Way
43mLocate all the things
01h 41mOpenStreetWhat? Mapping The World With Open Data
34mReal-Time Analytics: Going Beyond Stream Processing with Apache Pinot
06mLightning Talk: Leveraging Realtime Geospatial Data and the Spring Ecosystem to Save Lives, Solstice
01h 24mLightning Talks
43mBuilding a community fountain around your data stream