Demystifying Deep Learning for Data Scientists
summary
Shows how to implement linear, logistic and feed‑forward networks from first principles using NumPy-style code and Jax automatic differentiation, with working notebooks (instructor and student) runnable on Binder. Covers explicit MSE and cross‑entropy formulas, manual gradient descent by hand and a training loop that fits a 41‑descriptor biodegradability model, with practical fixes (smaller step size, numeric stability). Claims a prior case of 100x RNN speedup with Jax and frames everything as the model‑loss‑optimizer workflow.
AI-written summary · about
chapters (28)
- 0:00Deep learning fundamentals
- 1:26Workshop environment setup
- 3:12Course goals prerequisites
- 5:01Linear regression models
- 8:27Loss functions for evaluation
- 14:56Gradient descent optimization
- 16:30Gradient-based optimization crash
- 22:28Computational minimization with Python
- 29:52Gradient descent by hand
- 31:57Automatic differentiation with JAX
- 33:28Gradient descent and linear regression
- 34:52Model loss optimizer framework
- 35:22Optimizer components breakdown
- 37:17Linear regression in practice
- 44:38Logistic regression models
- 45:49Logistic curves exploration
- 46:10Logistic regression parameters
- 47:14Cross entropy loss
- 49:02Logistic regression with optimizer
- 54:37Neural networks approximators
- 55:20Feed forward architecture
- 56:43Biodegradable molecule dataset
- 58:39Neural network from scratch
- 1:00:13Training the model
- 1:05:37Confusion matrix evaluation
- 1:06:19Optimizer framework recap
- 1:07:02Modifying model loss
- 1:09:28Closing remarks resources
related talks
44mMachine Learning Exposed
51mMachine Learning Exposed Deep and Reinforcement Learning
51mGetting Started with Deep Learning for Software Developers
27mDemystifying Deep Neural Networks
35mDeconstructing Deep Learning
51mDeep Learning - What is it and What It Can Do For You
01h 04mWhat you always wanted to know about Deep Learning, but were afraid to ask
43m(Deep) Learn You a Neural Net for Great Good!
