Automatic DB annotation with ML tools and its problems
summary
Covers automating database labeling at SafeData using machine-learning tools, discussing which approaches and tools work and the pitfalls encountered. Describes how to balance rule-based methods (regular expressions) with ML techniques for backend data classification and tagging.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 2:08Profiler goals
- 5:43DB annotation evolution
- 8:11Regex optimization
- 11:21Synthetic dataset
- 15:14Classification experiments
- 19:10NER alternatives
- 21:59Hyperparameter tuning
- 25:55Future plans and limits
- 29:09Summary
- 29:54Q&A
related talks
40mData labelling to scale your ML and AI pipelines
25mAutomating Operations with ML
02mDBTB INT Omar Alonso
21mDataEngBytes 2023 - SYD-T2-04 - Suneeta Mall
44mContent Classification: NLP vs. AI in the Age of Data Vectorization
34m6 Tips to Avoid Pitfalls in Data Annotation
53mArtificial vs Natural Intelligence in Annotation Tasks
14mScaling ML platforms to industrialize AI/ML development