Crafting a Vision-Aided Software Stack for UAV
summary
A vision-aided UAV software stack is presented as a proof-of-concept: an open-source mission server that uses GStreamer for RTSP video streaming, MAVLink for telemetry and control, and a MAVLink router/serial multiplexer to combine 5G LTE and sub‑1 GHz backup links. It provides a camera/gimbal hardware abstraction, integrates with PX4/ArduPilot, targets Qualcomm RB5-class SoCs with hardware video/AI acceleration, and is demonstrated working end-to-end for capture, stream, and command.
AI-written summary · about
chapters (18)
- 0:00Introduction
- 2:32UAV mission server architecture
- 3:59Typical multi-rotor UAV system
- 5:47Embedded Linux on UAVs
- 7:54Software for deterministic missions
- 9:18Smart UAVs and task integration
- 10:24MAVLink protocol role
- 12:28Middleware for high-level tasks
- 13:13SLAM for UAV navigation
- 14:41AI and deep learning in UAVs
- 15:45Open-source autopilot systems
- 17:13Autopilot state estimator
- 18:40ROS vs LCM
- 21:33Camera and gimbal challenges
- 23:21Redundant MAVLink router
- 24:03Mission server proof-of-concept
- 25:51Multi-core flight control future
- 26:33Q&A
related talks
21mApidays Virtual Helsinki - Merja Kajava, Aavista
26mComplex Autonomous UAV Task Execution and Decision-Making Using s(CASP)
19mMission-Critical AI in Space and Sky: SWaP-Constrained Intelligence Wi...
57mDrones & AI - What's all the buzz about ?
41mAutonomous vehicle development with Unity
49mMonitoring global events with AI-driven satellite swarms
40mAccelerate autonomous vehicle development
09mLightning Talk: An Efficient Automotive Safety Support System Utilizing Hardware...