ApacheCon@Home 2021
| title | author | length |
|---|---|---|
| Apache Hudi : The Data Lake Platform | Vinoth Chandar | 50m |
Apache Hudi provides transactional updates/deletes and record-level incremental change streams over object storage, with deployed users at ByteDance and Uber… | ||
| Apache Fineract: the fintech core banking application | Javier Borkenztain | 37m |
Apache Fineract claims production use in 50 countries by 1000+ institutions and provides account, wallet, loan and KYC management with open APIs. The platform… | ||
| Processing Geospatial Data at Scale with Python and Apache Sedona (incubating). | Paweł Kociński | 41m |
Apache Sedona (incubating) Python API extends Spark 2.4/3.0 to load and process vector data at scale, with concrete examples using Docker notebooks and a NYC… | ||
| Making Cassandra Faster in Cloud-native architecture | Subrata Ashe | 39m |
Salesforce ports Cassandra 3.11 into Kubernetes with strict FIPS/non‑FIPS encryption and a service mesh, measures with nodetool/JMX plus perf, perf record and… | ||
| ApacheCon@Home 2021: Inside ApacheCon | Rich Bowen | 47m |
September 21–23 online conference runs 1300–2030 UTC each day and uses the Hopin platform; schedule highlights three keynotes (Ashley Wolfe on inclusivity… | ||
| Visual Flow, open-source ETL tool powered by Apache Spark | Dmitri Pavlov, Alexander Shevtsov | 24m |
Visual Flow is an open‑source, cloud‑native ETL GUI that stitches Apache Spark, Kubernetes and Argo into runnable workflows stored as config maps and workflow… | ||
| Getting Apache James to serve 1M+ digital mailboxes of all Estonian residents | Juhan Aasaru | 30m |
A national digital-mail system serves all Estonian residents — about 1.3M mailboxes — built in one year and going live at month end, using Apache James as the… | ||
| Storage-Partitioned Join for Apache Spark | Chao Sun, Ryan Blue | 39m |
Proposal adds storage-partitioned joins to Spark v2 data sources, aiming to skip expensive network shuffles by matching disk partitions instead of always… | ||
| From Camel to Kamelets: new connectors for event-driven applications | Nicola Ferraro | 43m |
Kamelets are reusable connector YAMLs that let event platforms like Kafka or Knative connect to 300+ systems via Apache Camel route templates and a JSON config… | ||
| Building modern SQL query optimizers with Apache Calcite | Vladimir Ozerov | 39m |
Apache Calcite provides a Java planner that implements cost-based and heuristic drivers plus a flexible rule engine that performs bottom-up and top-down… | ||
| Speed up your Lucene queries by avoiding searching | Adrien Grand | 36m |
Shows concrete tricks that turn slow Lucene queries into near-instant results: split hot filters into separate indices so those shards can run as term queries… | ||
| Expanding Fineract capabilities, a practical example | Frank Nkuyahaga | 38m |
Client growth from 11k to 430k clients and 12k to 500k savings accounts drives frequent connection timeouts and out of memory crashes under 40–100 tx/min… | ||
| Apache NiFi 101: Introduction and Best Practices | Timothy J Spann | 46m |
Introduction to Apache NiFi shows a runnable pipeline: start on laptop or Docker, run on Kubernetes with external storage, and scale from a single node to 100… | ||
| Testing Kamelets - Verify event sources and sinks with YAKS | Christoph Deppisch | 41m |
YAKS runs behavior-driven feature files as Kubernetes Test CRs and translates them into Cucumber+Citrus Java jobs, so a single YAML feature becomes an… | ||
| Next Level Spark on Kubernetes with Apache YuniKorn (Incubating) | Weiwei Yang, Chaoran Yu | 36m |
Apache YuniKorn replaces the Kubernetes default scheduler for Spark workloads and is running in production since July 2020, deployed at scale (small… | ||
| Monitoring and Alerting for Apache Solr with the Prometheus Stack | Timothy Potter | 51m |
Deploys a Prometheus stack via Helm with configurable retention (default ~30 days) and loads Grafana dashboards from configmaps. Metrics flow from Prometheus… | ||
| The future of Lucene's MMapDirectory | Uwe Schindler | 53m |
Lucene uses memory‑mapped files to avoid syscall and copy overhead but currently splits maps into 1 GB chunk workaround because Java ByteBuffer uses signed… | ||
| Introduction to AsyncAPI for Apache Kafka | Lorna Jane Mitchell | 39m |
AsyncAPI v2.0 describes Kafka brokers, topics and message payloads so a single YAML can generate docs and runnable clients. The demo uses @asyncapi/generator… | ||
| Architecture of Central Bank Digital Currencies | James Dailey | 46m |
Central banks are moving from theory to pilots: the BIS urges action, China runs a wide pilot and the Sand Dollar exists; a French‑Singapore demo proves… | ||
| Evolving Transactions in Apache Cassandra | Benedict Elliot Smith | 54m |
Cassandra reduces LWT phases by merging Paxos prepare and read, cutting geo latency from four to two wide‑area round trips for writes and to one wide‑area… | ||
| How Netflix Provisions Optimal Cloud Deployments of Cassandra | Joey Lynch | 52m |
Shows a concrete capacity planner that converts vague developer inputs (intervals like 1k–100k QPS, 100 GB–1 TB) into cloud Cassandra clusters by: profiling… | ||
| Splitting Monolith Application to Microservices | Andrei Shakirin | 57m |
E-commerce monolith is split iteratively into microservices using Apache CXF, Karaf and ActiveMQ plus Docker/Kubernetes, Helm, Terraform and Google Container… | ||
| Enabling FIPS for Tomcat | Amit Pande | 50m |
Shows how to run Tomcat 9.0.52 on Java 8 with the bouncy castle fips provider and a Tomcat lifecycle listener that registers it and reconfigures JSSE so JVM… | ||
| Under-The-Hood of Druid without Zookeeper on Kubernetes | Himanshu Gupta | 36m |
Claim: Druid runs without ZooKeeper on Kubernetes by replacing coordination with Kubernetes APIs and an HTTP long‑polling state sync layer. Implementation uses… | ||
| Building Kubernetes Microservices with Apache Thrift | Randy Abernethy | 47m |
Thank you to all of of our ApacheCon@Home 2021 sponsors, including:
STRATEGIC
---------------
Google
PLATINUM
--------------
Apple
Huawei
Instaclustr
Tencent… | ||
| The Groovy Way of Testing with Spock | Naresha K. | 35m |
Argues Spock delivers clearer, shorter tests by using Groovy features such as given-when-then structure, Groovy power asserts that show exact expression… | ||
| Introduction to new GeoSPARQL features with Apache Jena | Marco Neumann | 39m |
Apache Jena adds a GeoSPARQL module that implements OGC conformance classes, supports WKT and GML, and plugs into Apache SIS to transform spatial reference… | ||
| Camel K and Serverless in Action - When to use it | Mary Cochran | 37m |
Camel K runs Camel routes as single-file integrations deployed to Kubernetes or OpenShift via a camel k operator and CLI, using Quarkus for supersonic… | ||
| Apache Karaf 5 and Decanter for overall observability | JB Onofré | 35m |
Karaf 5 is a refactor that removes OSGi core and replaces it with a service loader/registry, a builder API, and core config and lifecycle services; it supports… | ||
| Process Batch transaction using AzureBlob Integration with Apache Camel | Srikant Mantha | 27m |
A Camel Spring Boot service reads Azure Blob containers on a timer, transforms XML/CSV/ZIP payloads to JSON, calls an external REST to deduplicate or create… | ||
| Monolith to Microservices: Modularizing Fineract 1.x | A. Vidakovic, N. Ambali, I. Molnar, V. Romero | 45m |
Proposes splitting a ~300000 LOC monolith into published jars across 12 top-level areas (portfolio has 29 modules) to enable targeted deployments and easier… | ||
| Getting further with Apache Camel on Quarkus | Alexandre Gallice | 35m |
Quick practical tour of using Camel Quarkus with real code: shows embedding Java beans, mocking endpoints for tests, and using 300+ connectors to consume from… | ||
| Practice of Apache APISIX in Low-Code Gateway | Zhiyuan Ju | 23m |
Apache APISIX implements a low‑code gateway that generates executable Lua DAGs and runs them inside APISIX to orchestrate existing plugins (about 15 built‑ins)… | ||
| Scaling Apache Solr -- Features Of Resilience | Atri Sharma | 44m |
Solr 8.7 introduces circuit breakers that use JVM % and load‑average thresholds per collection to return 503 when a node refuses new requests (time‑averaged… | ||
| Tika 2.0 -- Robustness and Scale | Tim Allison | 36m |
Apache Tika 2.0 modularizes parsers (Maven modules: standard, extended, ml) and splits server into a tika server core plus optional parser bundles so… | ||
| Apache Hive Replication V3 | Pravin Kumar Sinha | 42m |
Hive Replication V3 introduces policy-driven automation by turning REPL DUMP/LOAD into scheduled-query based orchestration, uses a staging area to avoid… | ||
| Containing an Elephant: How we moved Hadoop/HBase into Kubernetes and Public Cloud | Dhiraj Hegde | 46m |
Salesforce migrates multi‑petabyte HBase/HDFS clusters to Kubernetes on public cloud, keeping performance with EBS and spreading data across three AZs for… | ||
| Apache Camel 3: the next generation of enterprise integration | Claus Ibsen, Andrea Cosentino | 41m |
Apache Camel 3 splits the monolithic core into 42 jars for modular, pluggable use and reworks the routing engine to be fully non‑blocking and reactive; startup… | ||
| Apache DataSketches | Lee Rhodes | 33m |
An open source library in Java C++ and Python that implements streaming theta sketch and tuple sketches, KLL quantile and REQ quantile, CPC and HyperLogLog… | ||
| Cassandra Data Migration with Dual Write Proxy | German Eichberger | 35m |
A dual-write proxy (Apache-licensed) that exposes one Cassandra API endpoint and forwards writes to two Cassandra backends while preserving write timestamps… | ||
| Extending Fineract Accounting using Odoo ERP | John Ruhiu | 29m |
A working integration connects Fineract to Odoo so core-banking stays in Fineract while accounting and payroll live in Odoo. Changes include pushes customer… | ||
| Faster retrieval of top N documents in Apache Solr 8.6 | Tomás Fernández Löbbe | 42m |
Lucene 8.0 adds BlockMax-WAND and Solr 8.6 can use block-max indexing (requires an index built with Solr 8+) to skip non‑competitive docs and speed top‑N… | ||
| Apache Hop | Matt Casters (Kettle) | 42m |
Apache Hop is a metadata-driven orchestration platform rewritten from a 20-year codebase into a modular, lightweight system that boots in JVM startup time and… | ||
| Evolution from ESB to Cloud-native API Integration | Jeff Bruns, Andre Sluczka | 42m |
Chronicle migrates legacy silos into a cloud-native integration platform that stitches Shopify, Stripe, Salesforce, Marketo, Mailgun and Workcast into an… | ||
| Apache AGE | Eya Badal Abdisho | 34m |
Apache AGE is a PostgreSQL extension that adds a graph model to existing relational data without migration, implements openCypher for queries, and already… | ||
| IoTDB - Moving from Relational to Timeseries | Trevor Hart | 49m |
A remote-monitoring system migrates from H2/Postgres prototype to IoTDB because 10 hosts produce 5 GB in 30 days and queries take minutes; after migration 50… | ||
| OGC APIs: Web API Standards for Handling and Exchanging Location Data | Gobe Hobona, Scott Simmons | 31m |
OGC publishes a modular suite of web-API specs (Features, Processes, EDR, Coverages, Tiles, Maps, Styles, Records, Routes, DGGS and Common) with ISO 19168-1… | ||
| An introduction to the OGC API - Processes and practical examples | Benjamin Pross | 39m |
Overview of a RESTful OGC API for running geospatial algorithms with concrete demos: JSON and optional HTML encodings, OpenAPI schemas, and endpoints like… | ||
| A high-security API management infrastructure using Apache Camel | Yang Xie | 27m |
Shows a working API management stack built from Apache Camel plus Keycloak that fixes three concrete security gaps: minimal token validation, no per-API access… | ||
| Caching Proxy Configuration on the Traffic Control CDN | Robert O Butts | 36m |
A Perl monolithic cache-config tool is rewritten in Go as a set of POSIX-style apps that actually run: t3c apply, t3c request | t3c generate, t3c… | ||
| Apache Way in Tencent | Mark Shan | 15m |
Tencent maps the Apache InLong model onto internal platforms, claims over 130 open-source projects and reports ~15 million daily real-time analysis tasks, and… | ||
| Privacy on Beam - E2E Differential Privacy Solution for Apache Beam | Mirac Vuslat Basaran | 39m |
Privacy on Beam is an end-to-end differential privacy library for Apache Beam (currently Go, Python in progress) that implements calibrated noise, contribution… | ||
| Proxing to tomcat with httpd | Jean-Frederic Clere | 38m |
Apache httpd is configured as a reverse proxy to Tomcat using AJP, mod_proxy_ajp or HTTP backends (HTTP/1.1, H2C and HTTPS) with mod_balancer or mod_jk… | ||
| Stargate.io, An OSS Api Layer for your Cassandra | Cedrick Lunven | 49m |
Stargate is an open source API gateway for Cassandra that provides REST, GraphQL and document APIs, ships Docker compose examples and Java SDKs, and has ~500… | ||
| YARN Resource Management and Dynamic Max | F. Liu, F. Tian, P. Golash, H. Zhang, S. Zhang | 41m |
Uber runs YARN at scale with YRM self-service queue UI that decentralizes queue and capacity edits, enforces permissions, and cuts queue-related tickets by… | ||
| On the path to a massive scale SolrCloud: removing Overseer | Ilan Ginzburg | 43m |
SolrCloud removes the single Overseer bottleneck by making nodes update cluster state directly in Zookeeper using compare-and-swap (CAS) for state.json and… | ||
| Scaling Betfair Exchange to support 160k rps using Apache Kafka | Manjunath Shivakumar | 39m |
Betfair moves its exchange state onto Kafka, replacing a DB-bound monolith so read APIs scale to about 160k rps across 32 nodes and transactional input scales… | ||
| What makes Groovy a great scripting language | Kunal Dabir | 35m |
Demonstrates concrete, working Groovy scripts: parsing XML with XmlSlurper to convert Maven coords into Gradle form, a usable maven-to-griddle CLI that wires… | ||
| ApacheCon@Home 2021: In conversation | Sharan Foga | 36m |
Community track lists 16 sessions and explains why community over code matters: sustaining projects through onboarding, governance and non‑code contributions… | ||
| Getting Started with Event Stream Processing via Apache Flink on Microsoft Azure | Israel Ekpo | 20m |
Apache Flink runs batch and streaming from the same APIs and deploys on Azure via VM Scale Sets, Azure Kubernetes Service or partner platforms (Cloudera… | ||
| Groovy update: What's new in Groovy 3 and coming in 4 | Paul King | 40m |
Groovy 3 ships the Parrot parser and groundwork for module cleanup while Groovy 4 reaches release-candidate stage with over 500 contributors and a billion… | ||
| Pulsar Beam, HTTP streaming over Apache Pulsar | Ming Luo | 52m |
A Golang service exposes an HTTP POST for producing to Pulsar topics, an HTTP SSE interface for streaming consumption and a webhook-based push for deliveries… | ||
| Apache Tomcat: New and Upcoming | Remy Maucherat | 38m |
Tomcat moves to Java 11 and a 10.1 branch that requires newer JVMs, adds Jakarta EE migration tool integrated into auto-deploy (demoed converting the examples… | ||
| Streaming Geospatial Vector Data with Apache Projects | Jim Hughes | 40m |
Live AIS demo shows a working pipeline that ingests satellite feeds, converts messages to simple features, and streams updates to an in-memory map via Apache… | ||
| Off-Grid payments and ID | Orang Dialameh | 43m |
A working system combines a biometric smart card (fingerprint sensor, e‑ink display, secure enclave, Bluetooth/NFC/USB) with mobile wallets and a permissioned… | ||
| Blockchain, Fineract and the decentralized finance | D.G. Zaldívar, M. Beaudroit, J. Borkenztain | 40m |
Explains concrete integration paths: connect Fineract core banking to blockchains by delegating custody to self-custodial accounts (private/public keys) while… | ||
| Building resilient and scalable API backends with Apache Pulsar and Spring Reactive | Lari Hotari | 42m |
A Reactive Streams adapter for the Apache Pulsar Java Client plus a Spring Boot starter wraps Pulsar async APIs into Flux/Mono senders readers and consumers… | ||
| Apache Ignite Extensions - Modularization | Saikat Maitra | 42m |
Apache Ignite moves over ten streaming and connector modules (Flink, Kafka, Flume, MQTT, ZeroMQ, RocketMQ, Storm, Twitter, Camel, JMS and new community Pub-Sub… | ||
| Apache NIFi Deep Dive 300 | Timothy J Spann | 44m |
Run ListHDFS on the cluster primary node and pair it with Fetch for content to avoid duplicate scans; for stronger ordering and exactly-once push records to an… | ||
| Revolutionizing Fin Services in Africa on Fineract | A. Babalola, E. Cable, G. Kutumela, P. Kakoma | 58m |
Apache Fineract (Mifos) is used as a low‑cost core to digitize SACCOs, MFIs and fintechs: a cloud managed service model runs Kanzu Banking for group savings… | ||
| Fuzz Testing and Verification of Apache Cassandra with "Harry" | Alex Petrov | 44m |
Harry is a fuzzing and model‑checking component for Apache Cassandra that generates arbitrarily large, reproducible workloads from a single seed and… | ||
| Managing Custom Plugins and Forks of Solr | David Smiley, Nazerke Seidan | 43m |
Guidance for maintaining Solr plugins and forks that actually helps: use Lucene and Solr test artifacts (Lucene Test Framework, SolrTestCaseBase), write tests… | ||
| Improving interactive querying experience on Spark SQL | Ashish Singh, Sanchay Javeria | 24m |
Pinterest runs over 700 PB on S3 and ~150,000 daily compute jobs, so interactive Spark SQL needs low latency and isolation. The solution uses Apache Livy in… | ||
| Apache Wayang: Bringing Big Data to the IoT | Jorge-Arnulfo Quiane-Ruiz | 54m |
Thank you to all of of our ApacheCon@Home 2021 sponsors, including:
STRATEGIC
---------------
Google
PLATINUM
--------------
Apple
Huawei
Instaclustr
Tencent… | ||
| Did you get your ApacheCon tshirt yet? | 01m | |
Announcement lists 14 tracks of content covering project communities named in the captions including Cassandra, Camel incubator, search, big data, APIs and… | ||
| Apache Website Generation with Pelican | Dave Fisher | 40m |
Apache migrates its main site off the deprecated CMS by building a Pelican + Python pipeline that uses GitHub‑flavored Markdown, custom plugins (gen_id) for… | ||
| Open Data Lakes: Latest stop in the big data journey | Apurva Desai | 17m |
Claims that Dataplex unifies distributed storage, warehouses and lakes without moving data, centralizes the control plane to push policies and auditing across… | ||
| OLTP Application Data Services with Apache Geode | Gregory Green | 38m |
Apache Geode is an in‑memory NoSQL data platform that demonstrates transactional ACID behavior, strong consistency, and WAN replication while running on… | ||
| Functional Programming in Java, Groovy, and Kotlin | Kenneth Kousen | 43m |
Code-heavy comparison of Java, Groovy, and Kotlin showing actual code, a GitHub repo, and runtime details: examples of lambdas, method references, streams… | ||
| Kafka as a Platform: the Ecosystem from the Ground Up | Robin Moffatt | 41m |
Explains Apache Kafka as an immutable distributed commit log with topics, partitions and replica leaders, shows how producers and consumers use offsets and… | ||
| Data Lake as Source to Apache Flink to Better Support Machine Learning Use Cases | S. Irwin, C. Tan | 39m |
A custom Flink source reads Parquet files in S3 using the dlsync metadata stream as an index and parquet file helpers to track per-file progress. A Dual Source… | ||
| Fineract in Regulated Credit Unions | Art Muthiora, James Dailey, Rupesh Raikundalia, Luisa Martinez | 50m |
Assessing Apache Fineract for regulated credit unions with real pilots and concrete hurdles: an API-first core built on Fineract/Mifos components powers a… | ||
| Modeling Financial Data In Cassandra To Serve Real Time And Batch Workloads | Gokul Prabagaren | 21m |
Capital One uses Apache Cassandra plus Apache Spark and Spring microservices to store rewards so one Cassandra schema serves both real‑time customer views and… | ||
| Apache Ozone - State of the Union | Dinesh Chitlangia, Aravindan Vijayan | 42m |
Apache Ozone is a Raft-based scalable object store with decoupled namespace and block management, using RocksDB for metadata and an S3 gateway plus an OFS… | ||
| Tomcat: From a Cluster to a Cloud | Jean-Frederic | 38m |
Explains how Tomcat moves from multicast clusters to cloud deployments by using the Kubernetes API discovery or DNS membership to find peers, and compares the… | ||
| Extending Headless CMS APIs and Backend Services with Groovy | Russ Danner | 55m |
Claims that a headless CMS needs server-side programming and shows a working Groovy-based extension model inside Crafter CMS using Spring plugins and… | ||
| Cache Invalidation - Refresh vs Refetch | Taylor C. Frey | 25m |
Apache Traffic Control adds an invalidation type called refetch that forces caches to treat a resource as a miss and retrieve it from origin (not just… | ||
| Uber HDFS Unit Storage Cost 10x Deduction | Jeffrey Zhong, Jing Zhao, Leon Gao | 28m |
Claims unit storage cost drops from >$500/TB in 2018 to under $50/TB by combining hardware and software changes: move to high‑density spindles (35× drives at… | ||
| Community-led Security at ASF | Mark Cox | 19m |
Apache Security triages about 17,000 reports/year into roughly 1,000 threads and ~400 validated vulnerabilities, issuing about 150 CVEs/year via its CNA API… | ||
| Polyglot Apache PLC4X | Christofer Dutz | 47m |
Apache PLC4X generates drivers from a machine-readable m-spec format and language templates, producing more than 90% generated driver code for Java, Go and C… | ||
| Tracking and Triggering Pattern with Spark Stateful Streaming | Andrei Ionescu | 45m |
A long‑running Spark Structured Streaming tracker processes metadata only, grouping incoming events with mapGroupsWithState into accumulator objects and firing… | ||
| AI For All: Enhancing Digital Financial Services using Data Science | A. Ramesh, J. Engelbrecht | 41m |
Mifos demonstrates a working pipeline: OCR (CNN) extracts three months of bank statements, NLP (bag‑of‑words / TF‑IDF) categorizes line items, and… | ||
| A machine learning hub for IoT data using Apache Madlib | Nitin Borwankar | 34m |
Sets up a local IoT hub that keeps sensor CSVs as virtual tables in Postgres and runs in-db ML with Apache Madlib using the file_fdw foreign data wrapper and… | ||
| The journey of migration between Apache SkyWalking and Service Mesh | Rei Shimizu | 40m |
A C++ SkyWalking SDK called cpp2sky C++ SDK is developed and embedded into Envoy so Envoy can parse SkyWalking’s sw8 header and forward traces, avoiding… | ||
| Democratizing ML Pipelines using StreamPipes | Philipp Zehnder, Marco Heyden | 43m |
An open source IoT toolbox that wires sensors, cameras and brokers into a drag‑and‑drop pipeline editor, running as Docker microservices with 30+ adapters… | ||
| BanyanDB: A Purpose-Built Observability database | Hongtao Gao | 37m |
BanyanDB is a purpose-built observability store for SkyWalking that implements the RAM conjecture to trade read latency for far lower memory and CPU costs… | ||
| Replicated Subscriptions: taking Apache Pulsar Geo-Replication to next level | Matteo Merli | 38m |
Replicated subscriptions in Apache Pulsar (introduced around 2.6 and matured by 2.8) keeps subscription offsets in sync across clusters by injecting marker… | ||
| HTTP/2, HTTP/3, and TLS State of the Art in our Servers | Jean-Frederic Clere | 45m |
Servers already enable HTTP/2 with TLS (OpenSSL 3.0 supported) and show a small CPU overhead from multiplexing; configuration is one connector or one line in… | ||
| Open Source Community--The Utopia for Programmers | Willem Jiang | 13m |
Argues that open source acts as a practical utopia by replacing manager-driven work with meritocracy, fast code review and feedback loops, and communal… | ||
| Proxy Pains and Benefits Supporting HTTP/2 End to End | Susan Hinrichs | 46m |
Adds HTTP/2-from-proxy-to-origin to Apache Traffic Server by refactoring transactions/sessions, implementing a connecting pool to queue requests while a single… | ||
| Apache MXNet 2.0: Towards Synergistic ML and DL with Standardization | Sheng Zha | 30m |
Apache MXNet 2.0 standardizes on the Python Array API and Open Neural Network Exchange (ONNX), adds numpy-compatible np/mpx arrays with automatic… | ||
| Adding Natural Language Interface To Minecraft Using Apache NLPCraft | Sergey Kamov, Nikita Ivanov | 36m |
Apache NLPCraft adds a deterministic natural language layer to applications by using a model-as-code approach (YAML + JVM code) with composable named entities… | ||
| The Future of Security for CQLSH | Arturo Hinojosa, Derek Chen Becker | 43m |
CQLSH currently supports only the plaintext password authenticator, and a CEP proposes making it loadable via an auth provider class in cqlshrc with key/value… | ||
| Scaling the Namenode - Lessons learnt | Dinesh Chitlangia | 41m |
Common causes of NameNode failure: millions of small files bloating metadata, suboptimal heap sizing (rule‑of‑thumb: ~1 GB heap per 1M blocks), excessive… | ||
| Cassandra powered workflows to automate at scale | Maciej Swiderski | 40m |
Demonstration shows Apache Cassandra used as the primary workflow store with the open source Automatico toolkit, creating per-workflow Cassandra tables… | ||
| Balancing data in Apache Ozone | Lokesh Jain, Siddhant Sangwan | 33m |
Thank you to all of of our ApacheCon@Home 2021 sponsors, including:
STRATEGIC
---------------
Google
PLATINUM
--------------
Apple
Huawei
Instaclustr
Tencent… | ||
| Distributed Java DBs Under the Hood: Main Components and Interactions Between Them | V. Kulichenko | 41m |
Uses Apache Ignite as a model and implements a simple Java distributed cache with string key/value put/get API, in-memory storage as a concurrent hashmap… | ||
| The Inclusive Community Imperative | Ashley Wolf | 15m |
GitHub reports 50 million users and projects doubling to 100 million developers within five years, driven by contributors from India, China, Africa and Latin… | ||
| Open Core vs Open Source | Anil Inamdar | 15m |
Argues that the open core business model starts with open source but systematically exploits a support gap → feature gap → delivery lock-in, migrating toward… | ||
| Covering indexes in Adobe Experience Platform Data Lake with Hyperspace | Andrei Ionescu | 40m |
Adobe Experience Platform runs Iceberg tables and adds Hyperspace indexes to cut query latency—benchmarks show up to ~20–25x speedups for Adobe workloads… | ||
| Building and maintaining an army of Camels to tackle your Problems | Christina Lin, Rachel Yordán | 47m |
Shows a working Camel K pipeline that streams a Telegram bot message into a Kafka topic, deployed to OpenShift via the Camel K operator which auto-builds… | ||
| Static websites using Apache Groovy | Sergio del Amo Caballero | 51m |
Thank you to all of of our ApacheCon@Home 2021 sponsors, including:
STRATEGIC
---------------
Google
PLATINUM
--------------
Apple
Huawei
Instaclustr
Tencent… | ||
| The architecture evolution of Apache DolphinScheduler | Lidong Dai | 40m |
Apache DolphinScheduler traces architecture changes from 1.2 to 1.3 and a planned 2.0 that aim to cut DB pressure and latency by moving work off the database… | ||
| Better and better: new features of Apache IoTDB | Xiangdong Huang | 45m |
Apache IoTDB since v0.12 adds a cluster module built on Raft with separate meta and data Raft groups (strong replication, optional eventual reads), a… | ||
| Payments: The Next Frontier | Istvan Molnar, Godfrey Kutumela, Victor Romero, Ed Cable | 48m |
An open source orchestration layer called Payment Hub EE links account systems (notably Fineract) to real‑time rails by running a stateful Zeebe/Camunda… | ||
| Enabling Mars Exploration with AHTSE | Dr. Lucian Plesea | 44m |
AHTSE is a set of Apache HTTPD modules that serve huge planetary tiles on the fly: it reads 20 TB high‑res J2K stored on S3 via split MRFs, uses mod_convert to… | ||
| Secure Apache Ozone with High Availability | Bharat Viswanadham, Xiaoyu Yao | 30m |
Apache Ozone adds High Availability (SCM HA in 1.0, OM HA in 1.1) and secures inter-service RPCs with mutual TLS for gRPC and delegation tokens for Hadoop RPC… | ||
| Apache Tomcat: Enabling Scripting Languages in JSPs | Rony G. Flatscher | 37m |
A JSP taglib implements a JSR-223 taglib for JSP that lets any javax.script or BSF engine run as if it were a servlet, receiving request, response and out; it… | ||
| Alluxio Data Orchestration for Machine Learning | Bin Fan, Lu Qiu | 45m |
Alluxio adds a POSIX layer with a JNI-based FUSE implementation, a distributed caching layer and a distributedLoad job to prefetch datasets; engineers optimize… | ||
| Getting back to sleep as soon as possible for the on-call developer | Shai Almog | 36m |
Middle-of-the-night payment failures trace to a microservice bug that hides from logs: filtering by 24085 user id shows no errors, but source inspection finds… | ||
| The Math of Reliability | Avishai Ish Shalom | 49m |
Begins with Guinness and the origin of the student t-test, then shows concrete math: a 15s probe with a 4-fail alert threshold gives 0.4^4 = 2.56% per-try but… | ||
| Unified fieldbus API with Apache PLC4X | Lukasz Dywicki | 48m |
Apache PLC4X provides one unified API that talks Profinet Ethernet/IP Modbus CANopen and claims coverage of about 47% of installed machinery. It supports… | ||
| Debugging complex issues in web applications | Mark Thomas | 50m |
Reproduces two real Tomcat bugs and shows concrete fixes and workarounds: a reproducible HTTP/2 semaphore deadlock triggered by three+ multi-GB concurrent… | ||
| An Introduction to Edge Extensions, Client API and Data Explorer | Dominik Riemer, Patrick Wiener | 44m |
Shows three concrete StreamPipes additions: a Data Explorer for persisted traces with charting (defaults to last 100 events and supports aggregates and… | ||
| CEOs Panel: How the business sees the platform | J.E. Saldarriaga, U. Dozie, J. Borkenztain | 35m |
Two fintechs build core banking on Apache Fineract: one passes its one millionth loan and the other launches a cloud native bank in a year with mobile account… | ||
| Extracting Insights from Big Data using Transactional ML with Kafka and Python | S. Maurice | 32m |
Defines Transactional ML as running AutoML on live Kafka offsets to train and update models continuously from joined JSON streams, using a Python low‑code… | ||
| Improving Testing Patterns for Apache Cassandra | Brian Houser, Arturo Hinojosa | 37m |
Cassandra 4.0 ships with about 5,700 unit tests and adds Cassandra 4.0 full query logging to enable replay and differential checks. The testing stack mixes ccm… | ||
| Uber achieves millions $ of savings managing disk IO across HDFS cluster | L Gao, E Sethuramalingam | 45m |
Company achieves ~45% storage unit cost reduction by deploying 16TB HDDs across HDFS and rebalancing IO so average cluster IOPS per TB stays even, yielding… | ||
| Building and Scaling Robust Zero-code IoT Streaming Data Pipelines | Paul Brebner | 34m |
Two zero‑code pipelines ingest NOAA tidal JSON via Apache Kafka and Kafka Connect, monitored with Prometheus and Grafana, and target either Open Distro… | ||
| Panel Discussion: Handling vulnerability reports in Apache Solr | C. Targett, D. Smiley, M. Drob | 53m |
Solr PMC handles a handful of vulnerability reports a year, routes initial reports to security@apache.org or security@solr.apache.org, assesses CVE-worthiness… | ||
| Open Hardware vs. COVID-19 at Wilson Center/NYU research | Alison Parker, Michael Weinberg | 19m |
Open hardware groups mobilize distributed design, testing and manufacturing using digital fabrication and modular parts, producing concrete results: 120,000… | ||
| Ozone - Performance at billions’ scale | Lokesh Jain | 35m |
Ozone claims HDFS-like throughput while scaling to billions of keys (tested to 10 billion, design target ~1 trillion) by replacing per-block state with 5GB… | ||
| OpenG2P one year on | Jill Shemin, James Dailey, Steve Conrad, Keyzom Massally, Victor Romero | 46m |
OpenG2P reports one year of building open source plumbing for cash transfers: a working reference architecture, alignment with GovStack building blocks, and… | ||
| Twelve OGC/ISO standards used in Apache SIS and other projects | Martin Desruisseaux | 37m |
Implements 12 OGC/ISO standards in Apache SIS and companion projects: metadata (ISO 19115/19157), coordinate referencing (ISO 19111/19162/19136), features and… | ||
| Casting the spell: Druid in practice | Itai Yaffe, Yakir Buskilla | 42m |
Nielsen Identity uses Apache Druid to serve subsecond, customer-facing analytics over tens of terabytes ingested daily and about 10 billion events per day… | ||
| End User Tracing in a SkyWalking-Observed Browser | Qiuxia Fan | 34m |
SkyWalking’s browser agent extends APM into the client by building five components that capture exceptions, map them to original code with source-map-based… | ||
| Creating an open, vendor-independent Industry 4.0 solution with IndustryFusion | Konstantin Kernschmidt, Matt Mikulina, Marcel Wagner | 40m |
Open-source IndustryFusion provides a vendor-independent, on-premise-and-cloud IoT stack (released under Apache-2.0) that actually runs: shop-floor gateways… | ||
| Versatility and Functionality of ApacheDrill | Misha Isran, Monty Rahman | 31m |
Apache Drill is an open-source ANSI SQL query engine that Datadistillr uses to avoid ETL overhead and query CSV, Parquet, JSON, S3/GCS and databases directly… | ||
| State of the Project & State of the Industry | James Dailey | 42m |
Overview of where Fineract actually is and what proved notable: the project has 41 committers and 19 PMC members and ships Fineract 1.5.0 (May/June), with five… | ||
| Making neural content meaningful and truthful relying on OpenNLP tools | Boris Galitsky, Jay Taylor | 38m |
A pipeline that cross-breeds raw and true content uses the OpenNLP similarity component to parse, form queries from noun/verb phrases, mine authoritative… | ||
| What's next for the Groovy web console? | Guillaume Laforge | 46m |
A redesigned Groovy web console v2 runs on Google Cloud with static front end on App Engine and a pool of Cloud Functions per Groovy version (Java 11)… | ||
| Apache Yunikorn: State of Union and Future | Julia Kinga Marton | 41m |
Apache YuniKorn is a stateless core plus shim scheduler deployed on Kubernetes with an admission controller and optional coexistence with the default… | ||
| Challenges of Spark Application coexisting with NoSQL databases | Gokul Prabagaren | 21m |
Capital One describes a rewards platform built with Apache Spark, MongoDB and Cassandra that processes millions of transactions daily and billions yearly; talk… | ||
| Exclusive Producer: Using Apache Pulsar to build distributed applications | Matteo Merli | 31m |
Apache Pulsar adds an exclusive producer mode (Pulsar 2.8) that exposes BookKeeper-style fencing to apps: a topic epoch counter in topic metadata increments… | ||
| Quantifying the growth and evolution of open-source communities with Apache Superset | Robert Stolz | 34m |
Claims a reusable, all-open-source data architecture that extracts Slack and GitHub into BigQuery (or Postgres), transforms with dbt, and visualizes in Apache… | ||
| Red Hat & Fintech - Bridging the chasm between analogue & 21st century digital banking | K. Switt | 33m |
Red Hat announces a fintech partnership program that evaluates startups’ business model, funding stage and community code security, offers free software and… | ||
| Exploring Socio-Technical Activities of ASFI Projects | Likang Y., V. Filkov, A. Ramchandran | 28m |
A web dashboard called ASFI Project Explorer visualizes monthly social (email reply) and technical (developer → file-extension commits) networks for 207 ASF… | ||
| The State of The Feather, 2021 | David Nalley | 23m |
The foundation now stewarding 227 million lines of code with a $22 billion replacement estimate reports concrete community and infrastructure changes… | ||
| Teaclave: Making Computation on Privacy-Sensitive Data Safe and Simple | Mingshen Sun | 34m |
Teaclave is an Apache-incubating open source confidential computing platform that runs functions inside hardware TEEs such as Intel SGX and cloud VMs (Azure… | ||
| Contributor Experience matters | Jarek Potiuk, Ash Berlin-Taylor | 40m |
Apache Airflow describes concrete results: switching from Travis to GitHub Actions plus self-hosted runners, Docker image caching, GNU parallel and selective… | ||
| Thursday Opening Remarks: ApacheCon @Home 2021 | Rich Bowen | 10m |
Opening remarks report concrete conference metrics and logistics: 3,500 registrations with about 50–58% turnout, attendees split 36% North America, 36% Europe… | ||
| Bleeding edge engineering behavior is Apache Way | Kanchana Welagedara | 46m |
FinTech teams adopt specific Apache Way practices: mailing-list archives and public repositories plus bug trackers for transparent history, a merit-based… | ||
| Datacubes: Enabling Space/Time Analytics and AI | Peter Baumann | 39m |
Argues that storing gridded Earth observations as multidimensional data cubes (space, depth, time, spectral) makes analytics and AI simpler and faster than… | ||
| Open Source, Fintech, and the power of communities | Graham McBain | 45m |
An open-source ACH library in Go plus a Docker image turns JSON into compliant NACHA files and handles wires, debit messages and Metro 2 reporting; one… | ||
| A Change-Data-Capture use-case: designing an evergreen cache | Nicolas Fränkel | 32m |
Claim: use CDC to keep a cache evergreen by streaming DB changes into the cache. Implementation reads the MySQL binlog via bezium, runs a small pipeline on… | ||
| Apache Liminal (Incubating)—Orchestrate the Machine Learning Pipeline | Aviem Zur, Assaf Pinhasi | 37m |
Apache Liminal provides a declarative liminal.yaml that builds Docker images, registers pipelines as Airflow DAGs, and exposes simple HTTP endpoints via a… | ||
| Un-breaking production bugs with non-breaking breakpoints | Brandon Fergerson | 26m |
Explains a concrete system that debugs live services without pausing them: non-breaking breakpoints are injected via runtime bytecode edits that call Apache… | ||
| ApacheCon @Home 2021: Wednesday Opening Remarks | Rich Bowen | 08m |
Welcome to day two with logistics and schedule specifics: a poll in Event tab asks how many ApacheCons attendees have been to, conference t‑shirts are… | ||
| Focusing on financial accessibility versus inclusion | Robert Jakech | 36m |
Argues that the priority is accessibility over inclusion: 1.7 billion lack any financial access and a startling 6 billion are underserved with slow, costly… | ||
| A Test Harness to Verify Traffic Router Performance | Zach Hoffman | 40m |
A Go rewrite of an internal Perl tool becomes the Traffic Router Test Harness that generates high-volume requests against Traffic Router using Traffic Ops… | ||
| What does the Treasurer's office do for the ASF, and how has it changed | Myrle Krantz | 36m |
Treasury organizes roughly $4M of funds, replaces a brittle Subversion invoice workflow with bill.com (reducing payment errors and syncing to accounting)… | ||
| Cracking the Nut, Solving Edge AI with Apache Tools and Frameworks | Timothy J Spann | 39m |
A concrete pipeline shows devices and Jetson gateways ingesting sensor and camera data with MiNiFi → NiFi → Pulsar, running on-device or gateway inference with… | ||
| Digitizing Savings-Led Financial Inclusion | W. Wasson, S. Blakstad, R. Timmer | 53m |
Claims that informal savings groups can be digitized into an on‑ramp to formal finance, backed by working products: an Android app with one shared phone per… | ||
| Updates on CDN Environment Automation and Managing a CDN Operating System at Scale | Jonathan Gray | 41m |
Apache Traffic Control automation now supports Postgres 10/12/13 and IPv6, moves Traffic Vault defaults from Riak to Postgres, and advances Traffic Ops API… | ||
| The democratization of integration - making. cloud native integration work | Mifan Careem | 39m |
Claims tens to hundreds of real projects inform the advice: over 1,500+ integration projects reviewed, integration consumes 50–70% of product engineering and… | ||
| The trials and tribulations of a CI pipeline on Apache Infra | Mick Semb Wever | 36m |
Apache Cassandra runs ~40,000 tests per commit across two CI fleets: commercial CircleCI for pre-commit and an ASF-hosted Jenkins cluster ci-cassandra backed… | ||
| Traffic Monitor Distributed Polling | Dave Neuman | 42m |
Traffic Monitor is refactored so a Go-based monitor can run in distributed polling enabled mode and split thousands of caches across tm groups instead of… | ||
| Apache Deep Learning 302 | Timothy J Spann | 53m |
Shows working pipelines that push data from Apache NiFi into Apache Pulsar and Apache Flink while calling models via MXNet Multi-Model Server and DJL; demos… | ||
| Who Pays for Open Source? | Shane Curcuru | 49m |
Major open source work is funded and executed largely by companies, not just volunteers: 50% of Apache committers report paid work, Drupal reports 69%… | ||
| Cassandra for giant 3D tables | David North | 31m |
Stores each table as cells and headers model in Cassandra, deployed on Kubernetes using the Bitnami Helm chart, with simple shell-script backup/restore and… | ||
| Apache Local Community (ALC): Present & Beyond | Swapnil M Mane | 42m |
Idea incubation starts mid‑2019 then moves into Apache Community Development: 160 mailing‑list emails, about 49 people and 38 replies refine the proposal and… | ||
| Community Health Reporting 101 | Sharan Foga | 43m |
Demo of Apache Kibble shows a live dashboard that pulls daily from 4,199 sources and aggregates code repos, issue trackers and mailing lists; it surfaces a… | ||
| Running an Apache Project: 10 Traps and How to Avoid Them | Owen O'Malley | 45m |
Ten practical mistakes and how to fix them: start IP early so code grants and corporate sign‑offs don’t delay Apache entry; publish on apache.org and advertise… | ||
| Bridging voter data and social data using Apache Streams | Brian Hodge | 40m |
Prototype system uses Apache Streams to normalize social and voter inputs, calls enrichment APIs (People Data Labs, Pipl) and processes results with Apache… | ||
| ApacheCon@Home 2021: Tuesday opening remarks | Rich Bowen | 08m |
Opening announcements list concrete facts: the event draws 3,000 attendees across the globe, features 250 speakers presenting in 195 breakout sessions, and… | ||
| The Future of Traffic Portal | Steve Hamrick | 39m |
Traffic Portal is being rewritten from AngularJS into modern Angular to replace a fragile v1 stack (npm + bower + grunt + browserify + compass) with TypeScript… | ||
| Architectures and Trends for Event Stream Processing on Azure with Open Source Software | I. Ekpo | 35m |
Survey of deploying Apache stream projects on Azure with concrete choices and gaps: offers Confluent Cloud or Azure Event Hubs (Kafka protocol) as fully… | ||
| Smart Transit: Real-Time Transit Information with FLaNK | Timothy J Spann | 46m |
A NiFi pipeline ingests geoRSS and RSS feeds, unzips or parses XML into JSON, normalizes a tab‑delimited point into latitude/longitude, and adds a unique id… | ||
| Running open source community in China, the experiences from openEuler | Zhenyu Zheng | 44m |
openEuler grows from H2 2020 to over 3,000 active contributors and 60,000 users by using a board governance plus distributed SIG model for development, weekly… | ||
| Defining the data model of HTTP messages, not just the format | Nicholas J. Car | 40m |
Proposes a concrete extension to HTTP: an Accept-Profile header (IETF draft + W3C docs) that lets clients request resources by data model rather than just… | ||
| Apache projects, let's embrace ARM! | Martin Grigorov, Yikun Jiang, Sheng Liu | 30m |
Effort adds real ARM CI and binaries across Apache: Hadoop ships Hadoop 3.3.0 ARM binaries after fixing dependency breaks (protobuf upgrade, node/native libs)… | ||
| Using Dashboards to Help Manage All Community Channels | Srini Kadamati | 32m |
Built a set of community dashboards that pull Slack and GitHub into a Postgres warehouse and visualize via Superset, showing concrete signals like 4,800 Slack… | ||
| CDN Locks: A way to ensure data integrity in the CDN | Srijeet Chatterjee | 27m |
A simple API-backed lock object (username, CDN name, message, lock type, timestamp) is implemented in Traffic Portal/Traffic Ops and ships in ATC 6.0 to… | ||
| Releasing binaries in the Incubator | Josh Fischer | 28m |
Heron is an Apache Incubator project that moves from source-only to distributing tar.gz source, compiled deb binaries (~500 MB each), and Docker images by… | ||
| How to Slide Your Release Pass the Incubator | Justin Mclean | 46m |
Explains exactly what the Incubator checks: source-only releases, cryptographic signatures, correct ASF headers, and a LICENSE plus NOTICE that reflect the… | ||
| Open Source Social Applications with Apache Streams | Steve Blackmon | 41m |
Apache Streams normalizes social exports to Activity Streams 2.0 and provides Java/Scala connectors for Twitter, Facebook, Instagram; the demo runs Flink and… | ||
| Mentors matter: Effect of mentors on project success in the Incubator | Curtis Atkisson | 41m |
Analysis of 286 incubated projects uses scraped ASF records and a logistic model regularized by lasso with leave-one-out CV to pick sparse mentor effects… | ||
| POI at 20 | David North | 33m |
Apache POI celebrates twenty years as a Java API for Microsoft Office formats, supporting old binary (.doc/.xls) and OOXML (.docx/.xlsx) formats with 250,000… | ||
| Apache TAC or "Here's how YOU can make it to the next real conference!" | Christofer Dutz | 39m |
The Apache Travel Assistance Committee funds travel, hotel, conference fees and modest subsistence payments for community members, coordinates bookings and… | ||
| PMEM-backed Repositories for more high-performance Apache NiFi | Takashi Menjo | 01m |
Proposal adds Content, FlowFile, and Provenance Repositories backed by persistent memory and implements access via Filesystem DAX and PMDK, modifying NiFi to… | ||
| From an idea to an Apache TLP | Christofer Dutz | 45m |
An open-source industrial connector library becomes a real Apache project: PLC4X starts as an MVP reading/writing Siemens S7, grows to four supported drivers… | ||
| Beyond bus-factor: data-visuals & algorithms to better understand Apache communities | Marton Elek | 42m |
Implements a small Go application plus Python notebooks that compute bus/pony factors from git and GitHub activity, and finds the standard file‑ownership… | ||
| Advice to Incubator Mentors | Justin Mclean | 38m |
Projects get three mentors as a typical minimum and usually take two to three years to graduate; mentors must help bootstrap infra, move sites onto ASF… | ||
| Hatching The Clutch - A Guide to the Apache Incubator | Dave Fisher | 41m |
Walks through how incubation is tracked and proposes concrete fixes: use clutch analysis plus Whimsy and the LDAP JSON to verify committers, require three… | ||
| Summary: 2021 Joint OGC OSGeo ASF Code Sprint | G. Hobona, A. Tzotsos, T. Kralidis, M. Desruisseaux | 44m |
Feb 17–19, 2021 virtual code sprint brings OGC, OSGeo and ASF developers together for three focused days to produce working prototypes of multiple OGC API… | ||
| nothing matches | ||