Conf42 Python 2024
who it's for
Python developers, machine learning engineers, data engineers, MLOps engineers, DevOps engineers, platform engineers, data scientists
topics
retrieval augmented generation; personalized image AI pipeline; transformers in healthcare; in-database model training; visual generative AI pipelines; Apache Arrow Flight client; Apache NiFi Python processors; Spin serverless WebAssembly; streaming DataFrames with Quix; SQL data refinement with Polars; building Hugging Face agents; probabilistic programming in Python
| title | author | length |
|---|---|---|
| Premiere - Conf42 Python 2024 | Sharon Yelenik, Joshua Arvin Lat, Sophie Soliven, Deepak Karunanidhi, Duncan Blythe, Jayram Palamadai, Chaur Wu, Dmitrii Ivashchenko, Alex Sharypov, Andre Santos, Petr Emelianov, Tamara Janina Fingerlin | 21m |
Personalizing images talk shows a concrete toolchain and a live demo that extracts per-image metadata to automate moderation and resizing; RAG session walks… | ||
| Personalizing Your Images with AI-Powered Features | Sharon Yelenik | 25m |
A demo app uses Cloudinary to auto-analyze uploads with faces=true, colors=true, OCR and moderation via AWS Rekognition and Google object tagging at a 70%… | ||
| Retrieval Augmented Generation for AI Apps | Sophie Soliven, Joshua Arvin Lat | 20m |
Claims that a basic generative AI app can be live in 24 hours if using a self‑hosted LLM, but a full RAG pipeline takes longer. Implementation uses Amazon… | ||
| Leveraging Generative AI and Transformers in Healthcare | Deepak Karunanidhi | 23m |
An anomaly-identification pipeline ingests social media and email data, labels ~20,000–30,000 records, fine-tunes BERT/BioBERT/XLM‑RoBERTa via Hugging Face… | ||
| SuperDuperDB: Bring AI to your favourite database! | Duncan Blythe | 22m |
SuperDuperDB claims to run models where the data lives so you never copy or ETL data, offering a Python package plus a deployment orchestrator using Ray… | ||
| Decoding Algorithmic Artistry: Visual Generative AI | Jayram Palamadai | 25m |
Explains how modern diffusion pipelines power DALL·E 3, MidJourney, Stable Diffusion and introduces OpenAI’s Sora text-to-video as a step-change; describes… | ||
| Leveraging the Apache Flight Python Client and InfluxDB | Anais Dotis-Georgiou | 24m |
Shows using the Apache Arrow Flight Python client and the InfluxDB v3 Python client (which wraps Flight) to run SQL or InfluxQL queries and return pyarrow or… | ||
| Building Apache NiFi 2.0 Python Processors | Timothy J Spann | 29m |
NiFi 2.0 adds first-class Python processors that run with requires Python 3.10 and JDK 21 and wrap real libraries: Hugging Face, spaCy, PyTorch, IBM WatsonX… | ||
| Empowering AWS DevOps with Python and Machine Learning | Gustavo Amigo | 34m |
Uses Python data tools and a simple ML regression to map RPM to CPU (40k RPM → ~30% CPU) and to discover a latency cutoff at ~50% CPU where response times… | ||
| Virtual-Physical Environment Manipulation System based on ROS | Ivan Chiou | 41m |
A web-based digital twin synchronizes a 6-axis robotic arm with a physical unit, using three.js for 3D visualization and a Python backend that… | ||
| Build a Serverless WebAssembly App in Python using Spin | Sohan Maheshwar | 31m |
Claims that WebAssembly will power the next wave of cloud compute, then shows concrete steps: create a serverless Python app with the Spin CLI in three… | ||
| Streaming DataFrames: A New Way to Process Streaming Data | Tomas Neubauer | 21m |
Library called Quix Streams presents a Python-first way to process Kafka streams without a JVM, using Docker + Kubernetes for containers and Kafka changelog… | ||
| Sketching Algorithms: Making Sense of Big Data in a Single Stroke | Tun Shwe | 24m |
Sketching algorithms produce approximate answers orders of magnitude faster than exact queries by keeping a few kilobytes of state, processing each item in a… | ||
| Advanced API Design for Scalable Distributed Systems | Santosh Nikhil Kumar | 38m |
Compares REST over HTTP for external gateways and Thrift code generation + binary RPC inside the backend, claims binary Thrift beats JSON for latency, and… | ||
| Data Refinement: Unleashing the Power of SQL in Python using Polars | Tom Levy | 15m |
Polars runs on Rust with Apache Arrow memory, exposes SQLContext and an easy Python API, and uses lazy frames to query very large files (example: a Pokemon CSV… | ||
| Implementing Hexagonal Arch in Serverless Apps | Hazel Andrea Saenz Giron | 27m |
Shows a concrete implementation: a single AWS Lambda contains a core domain layer with two adapters one that writes to DynamoDB and one that sends email via… | ||
| Functor Zoo | Chaur Wu | 23m |
Demonstrates concrete Python code using the FunkLIFT library to treat collections and effects as functors: maps a list [1,2,3,4] with CList.fmap, wraps console… | ||
| Exploring the Latest Features of Python 3.12 | Dmitrii Ivashchenko | 15m |
Concrete upgrades: generics use bracket syntax and the new type statement for cleaner aliases, TypedDict now appears in function signatures, and an override… | ||
| Improve application and code quality without overengineering | Alex Sharypov | 16m |
Example: an API that fetches statistics from other services needs only an async FastAPI app that makes on‑demand requests and handles several dozen requests… | ||
| How Python can handle and help you with repetitive tasks! | Andre Santos | 14m |
Demonstrates a working Python RPA that reads an Excel list, opens a desktop application one code at a time, copies the returned description and writes it back… | ||
| Next-Gen PeT: the Future of Multi-Party Computation Software | Petr Emelianov | 22m |
Shows how secret sharing and replicated sharing on three non‑colluding servers compute private operations (demonstrates 3 × 6 = 18 via share algebra) and how… | ||
| Use frameworks to test Apache Airflow data pipelines | Tamara Janina Fingerlin | 46m |
A tiny demo project builds a two-task math DAG with a custom BasicMath operator that pulls a random number from an API and writes to local Postgres, and it… | ||
| Lessons Learned From Maintaining SDK in Python for Three Years | Adam Furmanek | 54m |
Three years of iteration yields three concrete approaches and one clear lesson: the first SDK-per-stack solution works but multiplies maintenance across… | ||
| S, BB, X, Y, Z, a - a plethora of generations in Tech | Paweł Zajączkowski | 41m |
Gives concrete cohort boundaries (Silent >77, Boomers 58–77, X 42–58, Millennials 27–42, Z 10–26, Alpha <10) and workforce samples showing 80% millennials in… | ||
| Unlock the Power of LLM: Build a HuggingFace Agent | Darya Petrashka | 28m |
Builds a working Hugging Face agent that chains real tools: uses Hugging Face Agents and OpenAI agent, requires a Hugging Face token and OpenAI key, and boots… | ||
| Use of Python for Cutting edge Language Model research | Boluwatife Ben-Adeola | 40m |
Claims that model functions can be ported by copying an average activation vector across contexts, implemented with the NN-Sight Python API and a remote NDIF… | ||
| Balancing speed and accuracy in model development | Ivan Popov | 25m |
Argues that business value comes from choosing speed or accuracy by objective and then applying concrete tools: profile Python preprocessing with Yappi… | ||
| Python Security Best Practices Against Vulnerabilities | Ukanah Dean | 54m |
Covers concrete vulnerabilities (SQL injection, XSS, CSRF, command injection) with past breach counts like LinkedIn 6.5M and Dropbox 68M, demonstrates… | ||
| A Python Sandbox for Dynamic Rule Execution | Zhiya Zang | 15m |
A customized Python sandbox implements resource.setrlimit to cap CPU, memory and file usage, uses ast static analysis plus a module/function blocklist to catch… | ||
| How to prove the safety of your software | Marco Verleun | 25m |
A concrete method to check software safety: generate an sbom with sift, analyze it with grype/grip and upload to dependency track for continuous matching… | ||
| Apache NiFi, Kafka, RisingWave, Iceberg + Stock Data | Karin Wolok, Timothy J Spann | 28m |
Live pipeline demonstrates real-time stock ingestion from websockets and APIs into Apache NiFi and Python processors, publishes JSON to Kafka, materializes… | ||
| Writing Python Codemods for Fun and Profit | Dan D'Avella | 47m |
Open-source codemodder installs via pip and runs over a Python repo, applying about 40–50 ready codemods and custom plugins. It consumes SARIF or invokes… | ||
| Probabilistic Programming in Python | Salman Saeed Khan | 14m |
Demonstrates building a Bayesian logistic regression in Python using Stan and an MCMC sampler on a height/weight/gender dataset, replacing single-point… | ||
| nothing matches | ||