Advanced static site generation
summary
Uses GitLab CI and Pages with SQLite-based cache plus jinja2 matplotlib and plotly to do incremental scraping, splitting long scrapes into shorter jobs that explicitly timeout before the GitLab six-hour limit and then retrigger via API with env-start points so work resumes where it left off. Runs multiple scheduled pipelines by switching behavior with environment variables. Shares the SQLite DB through CI cache to avoid merge logic. Notes limited secret granularity and nonzero internal maintenance.
AI-written summary · about
related talks
43mHow to simplify your life by embracing static site generation
52mBACK to the Future: Static Blogs and Websites with Jekyll
32mStatic Sites go all Hollywood
08mFrom Jamstack to Incremental Static Generation
15mUsing GitLab to Power our Frontend Technical Interviews
47mBuilding Scalable Web Apps
42mEngineering Documentation
04mThink outside the box