~/talk

All about AI Toolkit for Visual Studio Code

on YouTube 11m
Talkat Microsoft Build 2024 · 2024-05-21..05-23· [ai-assisted-development, large-language-models]

speaker

name:John Lam
links:none on file

resources

video:https://youtu.be/-ptP155M0Tc
slides:none on file

summary

AI Toolkit for VS Code shows how to acquire curated small models, run them locally on a laptop GPU, evaluate changes and fine tune for specific tasks. It demos downloading Phi‑3 mini, using Azure Studio for evaluation, and local fine tuning (or Azure Container Apps in private preview). A 2,300 Q&A dataset raises category prediction from 14% to 91% accuracy and outperforms a GPT-based baseline at this task. local model download fine-tune with 2,300 Q&A 91% category accuracy

AI-written summary · about

chapters (7)

  1. 0:00AI Toolkit intro
  2. 1:34AI Toolkit interface & models
  3. 3:02Run Phi-3 mini locally
  4. 4:10Fine-tuning for predictions
  5. 6:41Model evaluation & off-topic handling
  6. 8:063 steps to use AI Toolkit
  7. 9:32Call to action & resources

related talks

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.