Ingest node: (re)index and enrich documents in Elasticsearch
summary
Introduces Elasticsearch Ingest Node, a node type that performs simple data-transforming pipelines inside Elasticsearch instead of before indexing. Explains integrating Ingest Node with the Elastic stack, building custom Ingest plugins (demo: ingest-bano to enrich French postal addresses and geocoordinates), and using the reindex API with ingestion pipelines to modify data on-the-fly during reindexing.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 5:45Need for ingest nodes
- 8:56Ingestion pipelines
- 17:43Ingest nodes role
- 23:06Reindexing with pipelines
- 24:08Custom ingest plugin
- 35:01Pipeline demo
- 48:29Q&A
related talks
27mIngestify: Rethinking Ingestion for Complex Data
28mEnhancing Elasticsearch Performance: Innovative Reindexing...
10mGetting Your Data into Elasticsearch: Let Me Count the Ways
53mReindexer - a very fast in-memory DB with full-text search
29mHow (not) to Scale Elasticsearch for Data Analytics!
57mAn Introduction to Elasticsearch for .NET Developers
42mIngestion at Scale: Open Source Pipelines for Getting Data Into Open...
47mMake sense of your (big) data using Elasticsearch