Unveiling the Test Champions: Comparing Testing Automation Systems for Embedded...
summary
Compares five systems — lava, labgrid, boardswarm, Beaker and testing‑in‑a‑box — by actually installing and running virtual tests, plus a microSD multiplexer and custom PDU for hardware bits; finds lava: scheduler, YAML test library, Prometheus integration, cloud‑ready is best for batch/CI and VCS hooks, labgrid: interactive sessions, wide hardware drivers and boardswarm excel for hands‑on device access, Beaker has the clearest docs, and testing‑in‑a‑box supplies reusable hardware designs though hardware was not fully exercised; recommends hybrid deployments and early community engagement.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 1:49Motivation
- 7:52Testing automation systems
- 16:56Use cases
- 22:07Experiences
- 29:47Recommendations
- 36:55Q&A
related talks
41mUnveiling the Test Champions: Comparing Testing Automation Systems for Embedded...
44mAutomation beyond Testing and Embedded System Validation
48mPrimer: Testing Your Embedded System - What is a ptest, Lava, Fuego and...?
40mAutomated Full System Testing on Hardware with OpenQA
41mAutomated Full System Testing on Hardware With OpenQA
33mAutomated Testing for Embedded Development: Next Generation Board Farming
45mPanel Discussion | Test Automation Trends
55mShifting the Testing Role Pendulum