Organizing and Maintaining Your Code-Scape with Python
summary
Practical workflow showing lightweight Python scripts run from Jupyter notebooks to manage a personal “codescape”: folder conventions that promote moving a topic into a repo, handling an 8 TB external drive, and automating syncs across laptop, research machine, cloud, and archives. Includes a compare-and-sync dry-run with rsync utility, a recursive tree-to-JSON flatten for pandas to inspect disk usage, simple git-push/pull automation across many repos, GitHub API hooks for archiving Classroom forks, and notes on duping, large-data omission metadata, and possible integration with git-annex.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 3:40Codescape concept
- 7:54Python for automation
- 12:09Folder structure design
- 13:12Python example: folder structures
- 16:02Python example: JSON folders
- 19:40Python example: repos
- 22:28Automation scripts
- 24:39Q&A
related talks
42mSimplifying Data Analysis with GitHub Codespaces, Jupyter Notebooks & Open AI
41mBetter Code for Data Science
32mGit yourself a leg up for student projects
21mTeach Your Old Code New Tricks: Automating Code Quality in Large Projects
26m(Professionally) Coding with Others
32mAutomating teaching about automation in Python
25mMaking Codebases Easier to Learn and Maintain
29mOh no! I think my project is outgrowing my Jupyter notebook. How do I survive?