~/talk

Master 2.5 GB of unstructured specification documents with ease

Talkat PyCon.DE 2017 · 2017-10-25..10-27· [python]
links:none on file
slides:none on file

2.5 GB of messy .doc/.docx become structured JSON and a local browser UI that loads and full‑text searches everything in about 6.5 seconds. The pipeline uses pywin32 to drive Word exports to HTML, falls back to mammoth/python‑docx where possible, scrubs HTML with BeautifulSoup, extracts headings/tuples, analyzes co‑occurrence with pandas, builds graphs with networkx + py2cytoscape/cytoscape, and serves a serverless JS frontend with endless scrolling, recommendations and typo detection — it works and scales.

AI-written summary · about

  1. 0:00Introduction
  2. 0:56Outline
  3. 1:33Background
  4. 2:20Key challenge
  5. 5:18Target areas
  6. 6:53Solution overview
  7. 9:54Existing frameworks
  8. 12:38MS Word
  9. 13:59Identify relationships
  10. 15:48Identify relationships across documents
  11. 17:53User interface
  12. 19:43Call graph
  13. 23:08Conclusion
  14. 25:33Case study
  15. 27:23QA
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.