Workflow in Jenkins

on YouTube ↗46m

" summary

Build system implemented as a text-based Groovy DSL that runs on Jenkins 1.580+, published as open source (0.1 beta5), supports parallel stages, mid-build artifact archiving, human approval via an input step, and reusable functions. Execution uses a custom CPS-based execution engine that serializes program state so runs survive Jenkins restarts (demo shows restart during a run) and enterprise adds checkpoint resume for very long builds (example: avoid redoing 31–32 hour work). Docker demo and snippet generator exist.

AI-written summary · about

" chapters (6)

1. 0:00Intro
2. 2:31Use Cases: orchestrated activities • Multi-stage continuous deployment pipeline • Run part of build with a temporary server • Blue/green deployment + auto commit/abort • Parallel tests with automatic sharding • Automatic per-branch jobs (à la Literate)
3. 4:57Characteristics • Complex pipelines involving multiple stages • Non-sequential logic such as loops and forks • Long-running builds must survive outages • Interaction with humans pauses, input • Restartable builds in case of a transient error • Reusable definitions to avoid duplication • Comprehensible scripts one clear definition
4. 11:37Key features (what I already covered) • Entire flow is one concise Groovy script -for-loops, try-finally, fork-join, etc. . Can restart Jenkins while flow is running • Human input/approval integrated into flow
5. 18:47Resumption of Groovy flows • Transformed to continuation-passing style • Run on custom interpreter of Groovy • State of program saved at each pause point • Variables serialized and restored after restart - pickles: extensible object replacements
6. 44:57Summary • Simplifies complex orchestration • Define everything in single job • Workflow as Groovy code • Survives IVM loss, and even restartable • Extensible

" related talks

• 46mWorkflow in JenkinsKohsuke Kawaguchi, Jesse Glick · Jenkins User Conference US West (JUC San Francisco) 2014
• 48mWorkflow in JenkinsJesse Glick · Jenkins User Conference Boston 2014
• 49mJenkins Workflow: What's Up?Jesse Glick · Jenkins User Conference U.S. East 2015
• 43mGetting Groovy with JenkinsLorelei McCollum · Jenkins User Conference U.S. East 2015
• 34mContinuous Delivery with Jenkins WorkflowMartin Reinhardt · code.talks 2017
• 04mContinuous Delivery with Jenkins' New Declarative Pipeline & ArtifactoryPatrick Wolf, Ian employee · swampUP 2017
• 35mJenkins Scaling and Organization for an Efficient CIAndrea Giardini · DevOps Pro Europe 2019
• 22mAdvanced Workflows for Multi-Platform Mobile DevelopmentEmanuele Zattin · Jenkins User Conference US West (JUC San Francisco) 2014