~/talk

Accelerating PostgreSQL Full Table Scan OLAP queries

Talkat Data Science Conference 4.0 · 2018-09-18..09-19· [databases, data-engineering]
links:none on file
links:none on file
slides:none on file

Tests use PostgreSQL on AWS against a generated 165 million rows / 22 GB dataset and three OLAP queries; a columnar engine cuts disk I/O by about 30% less disk I/O and helps narrow scans when few columns are needed, but can be slower on small scans. A CUDA GPU path (PG strong) achieves up to GPU 400-way parallelism and 10–15% speedups on simple scans but becomes 10–40x slower when multiple joins force data back to the CPU; best results require NVMe + GPU in a single box.

AI-written summary · about

  1. 0:00Introduction
  2. 2:20Overview
  3. 11:26Possible solutions
  4. 11:58Storage engines
  5. 14:42PGStrong
  6. 15:27Test cases
  7. 15:53Data model
  8. 19:45Query types
  9. 21:06AWS tests
  10. 21:59Results
  11. 26:36Second query
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.