IGNITE: How to collect Telemetry data using Memphis.dev?
summary
Builds a telemetry pipeline in a few hours using Memphis.dev by swapping the managed broker for a station called user_traces, with user brokers producing messages and custom consumers pushing to BigQuery using the existing schema. Code change is minimal — replace connection and produce to the new station — and it works. Adds homemade functions for enrichment, uses remote storage for expired messages, scales consumers for throughput, keeps Tableau visualizations, and surfaces geolocation and early error signals.
AI-written summary · about
related talks
01h 08mWorkshop: Analyzing and Visualizing OpenTelemetry Traces with SQL
24mData analytics with distributed tracing data
28mDataEngBytes 2023 - MEL-T1-11 - Emily Melhuish
41mPredictive Maintenance with Azure Synapse
33mAccidental DataOps: How we matured our organization with data, and how you can too!
13mData for product
38mInfrastructure Monitoring Basics with Telegraf, Grafana and InfluxDB
36mTelemetry Analysis for Scaling