ASSIST: Automated Feedback Generation for Syntax and Logical Errors in Programming(…)
summary
ASSIST is a tool that combines fault‑tolerant parsing via tree-sitter with assignment‑specific rewrite rules and program synthesis using Sketch to produce actionable fixes. The system fixes syntax errors in 71% of syntax‑error submissions, extends to logical fixes for 34% of those, and provides logical feedback for 64% of 4,735 incorrect submissions. Syntax correction averages ~100 ms, synthesis‑based logical feedback runs in a few seconds on average (worst mean 7.3 s).
AI-written summary · about
chapters (12)
- 0:00Automated feedback intro
- 1:08Syntax errors with Tree-sitter
- 3:15Fixing annotation errors
- 3:56Logical errors via synthesis
- 6:00Testing on student submissions
- 7:43Performance on incorrect programs
- 8:46Comparison with Autograder
- 9:07Speed and usability
- 10:10ASSIST features
- 11:55Error detection limits
- 13:40Future feedback steps
- 15:07Q&A
related talks
45mAI Assistance for Software Teams: The State of Play
01h 06mOn-The-Fly Verification via Incremental, Interactive Abstract Interpretation wi...
06mHow Automated Tools Can Communicate Effective Strategies for Fixing Bugs
33mAI assisted software delivery
28mFixit linter+AI coding
20mAn Approach to Generate Text-Based IDEs for Syntax Correction based on Syntax Specification
16mVisual statical analysis tool
29mBending the Curve: A Personal Tutor at Your Fingertips