~/talk

Fighting Corruption with Technology

Talkat Techsylvania 2018 · 2018-06-09..06-12· [data-engineering, machine-learning]
links:none on file
slides:none on file

Claims that current systems catch only 1–3% detection today and therefore fail, and that a scalable pipeline named ComplyDetect pipeline builds a usable alternative. System downloads the web with Hadoop crawlers, streams pages into Kafka, runs NER and three ML detectors (politician, relationship, crime) trained via active sampling at decision boundaries, stores results in MongoDB and Elasticsearch, and processes 20 million documents a day—about 800× the throughput of manual analysts—intended to surface laundering links for onboarding and transaction screening.

AI-written summary · about

  1. 0:00Introduction by host
  2. 1:02Can technology fight corruption
  3. 2:26Corruption's human cost
  4. 4:32Scale of money laundering
  5. 6:47Politicians and financial risk
  6. 8:11Networks of corruption
  7. 9:15Problem for banks today
  8. 11:02Public data challenge
  9. 12:24Building a tech solution
  10. 13:25Hadoop for big data
  11. 14:10Kafka for streaming data
  12. 14:51Named entity recognition
  13. 15:36Machine learning detectors
  14. 17:00MongoDB and Elasticsearch
  15. 17:44Training machine learning models
  16. 19:08Scaling with technology
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.