~/talk

Natural Language Processing with Deep Learning and TensorFlow

Talkat NDC Porto 2019 · 2019-02-26..03-01· [machine-learning, large-language-models]
links:none on file
slides:none on file

Walks through a practical pipeline: use a 128-dim TF Hub sentence embeddings as input to a DNN (512, 128 hidden layers) trained with TensorFlow Estimators for binary sentiment on the IMDb dataset, reaching roughly ≈79% accuracy on IMDb test set after 1,000 steps; builds a character-level generator with 512-unit LSTM with 128-dim embeddings using Keras over TensorFlow to mimic Shakespeare (training needs many epochs to improve); shows Cloud ML Engine for GPU/TPU-backed training, distributed training and hyperparameter tuning.

AI-written summary · about

  1. 0:00Introduction
  2. 1:02Speaker background
  3. 3:11NLP overview
  4. 5:57Complex NLP tasks
  5. 7:16Sentiment analysis challenges
  6. 8:45AI in Sci-Fi vs Reality
  7. 10:21Chatbots and QA
  8. 13:16Sentiment analysis demo
  9. 16:58Text feature engineering
  10. 22:52TensorFlow Hub
  11. 25:41Estimator API
  12. 26:26Demo: Sentiment analysis
  13. 33:24Text generation
  14. 34:16Shakespeare demo
  15. 40:06Model training and tuning
  16. 45:24Scaling with Cloud ML
  17. 52:08Conclusion and Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.