Writing Domain Specific Languages with Python

on YouTube ↗59m

" summary

Covers concrete techniques and tradeoffs: implementing DSLs with PLY and PyParsing, using the ast and tokenizer or metaprogramming (metaclasses, context managers, operator overloading) to map text into structures, and when those tricks bite back. Shows a working project — an adventure game script that wins Pi Week — with roughly 1,100 lines of DSL and ~3,000 Python lines. Argues metaclasses are safest, operator-overloading causes surprising precedence bugs, and custom parsers need clear errors and tooling.

AI-written summary · about

" chapters (13)

1. 0:00Introduction
2. 0:15Domain Specific Languages
3. 4:22What is a DSL
4. 6:02Metaclasses
5. 9:54Context managers
6. 11:17Operator Overloading
7. 21:22Parsers
8. 22:01DSLs
9. 28:51Do it Line
10. 35:35Linewise parses
11. 37:12Parser generators
12. 40:12PLY
13. 47:43Summary

" related talks

• 53mDomain Specifc LanguagesTobias Schlitt, Gordon Oheim · FrOSCon 2012
• 53mDeveloping DSLs in a pragmatic wayFederico Tomassetti · Voxxed Days Ticino 2017
• 22mLearning Parseltongue: Wizardry in PythonGaurav Dadhania · PyCon Australia 2013
• 01h 10mDomain Specific Languages: Molding RubyJoe O'Brien · MountainWest RubyConf 2008
• 45mReinventing the Parser GeneratorDavid Beazley · PyCon 2018
• 46mPython ships a ready-made frontend for your compilerPetr Sovetov · PiterPy 2023
• 38mDSLs, Code Generation, and New Domains for RubyJoel VanderWerf · RubyConf 2009
• 31mWrite your Own Domain Specific Language with F#Mikhail Smal · DevDays Europe 2019