How to Automate Everything
summary
Describes a banking automation platform that combines traditional API-based and computer-vision approaches across eight automation levels, using tools such as Selenium, Sikuli, Tesseract, ABBYY, AutoIt/WinAPI and a studio/recorder. Presents a deployed orchestration layer (bot manager with node allocation and MongoDB metrics), demos human-like mouse trajectories, a 500-action image-based game run, and end-to-end pipelines for testing and virtual Windows nodes, noting image-based flows work but are fragile in varied environments.
AI-written summary · about
chapters (19)
- 0:00Introduction
- 1:04What automation means
- 3:217 automation levels
- 8:30Desktop automation hurdles
- 11:01Legacy apps image-based
- 14:14Cognitive machines data extraction
- 18:59Chatbots conversational automation
- 19:42Process mining user actions
- 21:09Typical automation workflow
- 23:43Nikolai technical details
- 24:29Web and desktop automation tech
- 28:55Platform demo
- 31:31Realistic testing actions
- 32:34Selenium Grid testing
- 35:09Bot manager testing
- 36:59Studio recorder testing
- 39:51Eclipse tools
- 41:20Monitoring metrics
- 42:27Q&A
related talks
39mThe Future of Automation
44mAI Driven UI Automation, API Automation and CICD Integration
43mThe Road to Intent-Driven Automation
33mReal Cross-Platform Workflow UI Automation
31mBuilding Agentic AI Platforms
57mRise of the Machines - Automate Your Development
29mAutomation first, People centric
16mAgentic Automation - change the world of business operations?