~/talk

Working interactively with large and remote datasets in...

Talkat PyData Austin 2019 · 2019-12-07..12-08· [developer-experience, web-platform]
name:Max Klein
links:none on file
slides:none on file

Three JupyterLab extensions aim to let the UI handle big remote data rather than forcing full eager downloads: @jupyterlab/hdf5 adds a server extension that lazily fetches chunks via h5py and a phosphor/datagrid frontend so terabyte files and a 100 million‑row dataset open interactively; jupyterlab-remote-data experiments with an alternative contents handler; jupyterlab-data-explorer offers pluggable loaders and grid/tree widgets and is the leading candidate to replace the file browser with hooks to inject import snippets into notebooks.

AI-written summary · about

  1. 0:00JupyterLab introduction
  2. 3:13Remote dataset challenges
  3. 5:37HDF5 integration
  4. 8:05HDF5 limitations
  5. 9:07Unified data integration vision
  6. 10:35Multi-file browser UI
  7. 11:53Q&A: JupyterLab vs Classic
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.