Handling, extending and presenting data with ELK+
summary
Uses Logstash + Elasticsearch + Kibana plus small Java and Node.js pieces to do real tasks not slides: reads Apache logs and a MySQL dump (parses the "INSERT INTO" file with Logstash CSV/grok), enriches registrations by looking up ZIP→lat/lon, stores geo polygons as percolator geoshape queries to map provinces, builds per-IP session summaries with a scripted upsert for session summaries, and computes people-in-room over time using ES aggregations and the new cumulative pipeline aggregation. Outputs a working D3/Leaflet floor map and timeline demo.
AI-written summary · about
chapters (10)
- 0:00Start
- 1:47What did you start using ELK for?
- 7:12Website logs - filter
- 10:32Registrations - input
- 11:09Registrations - filter
- 12:31Registrations - output
- 13:43Room events - input
- 14:24Room events - filter
- 21:54Percolator
- 28:54Data coupling
related talks
41mBetter Data Exploration and Visualisation with Elasticsearch and Kibana
42mMake your logs work for you
35mEnriching Postal Addresses With Elastic Stack
42mMake Sense of your (BIG) data!
47mMake sense of your (big) data using Elasticsearch
01h 01mData magic with the Elastic stack!
49mElasticsearch, Logstash & Kibana
01h 55mUse your data to tell stories