Promises and Queues: Using Unlikely Suspects to Handle Asynchronous Parallel Processing

" summary

Describes converting a black‑box 3D model processing pipeline into discrete, logged jobs using Jenkins to handle asynchronous, parallel tasks like manufacturability checks, sizing and pricing. Explains why Jenkins was chosen, how it fit this use case, and how the same job‑management patterns map to serverless approaches (for example AWS Lambda) for handling parallel asynchronous processing across platforms.

AI-written summary · about

" related talks

• 44mThinking Asynchronously: App Integration Patterns for MicroservicesRebekah Kulidzan · GOTO EDA Day 2022
• 41mPipeline Patterns and Antipatterns - Things your Pipeline Should (Not) DoDaniel Raniz Raneland · Øredev 2024
• 28mHiding in Plain Sight: Unmasking the Jenkins DSLMatt Moore · Jenkins User Conference San Francisco 2014
• 42mSeven Habits of Highly Effective Jenkins UsersAndrew Bayer · Jenkins User Conference San Francisco 2014
• 39mAsynchronous Processing for Fun and ProfityMike Perham · RubyConf 2012
• 02mTechniques to Speed Up your Build Pipeline for Faster FeedbackNaresh Jain, Ashish Parkhi · Agile Pune 2014
• 46mWorkflow in JenkinsKohsuke Kawaguchi, Jesse Glick · Jenkins User Conference San Francisco 2014
• 43mSeven Habits of Highly Effective Jenkins UsersAndrew Bayer · Jenkins User Conference Europe 2014 Berlin