~/talk

Speed up your Lucene queries by avoiding searching

Talkat ApacheCon@Home 2021 · 2021-09-21..09-23
links:none on file
slides:none on file

Shows concrete tricks that turn slow Lucene queries into near-instant results: split hot filters into separate indices so those shards can run as term queries instead of expensive conjunctions (benchmarks show ~1,500 q/s per core for term lookups vs ~10–50 for complex queries), use index sorting (sorting by brand/price collapses millions of posting-list jumps into a few seeks), and index shingles for phrase queries (works but shingles increase index size and only helps exact-slap phrases). Also mentions constant_keyword and ~20% indexing overhead for sorting.

AI-written summary · about

  1. 0:00Introduction
  2. 1:15Why optimize Lucene queries
  3. 5:57Optimizing heavy filters
  4. 10:35Short-circuiting facet requests
  5. 14:28Speeding up conjunctions
  6. 21:14Using shingles for phrase queries
  7. 25:27Q&A session
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.