Building gaming analytics online services with Google Cloud and Improbable
summary
Improbable provides an open‑source pipeline that accepts JSON over an HTTP REST endpoint (Python 3 on Kubernetes), writes newline‑delimited JSON to Cloud Storage, and optionally moves data into BigQuery via Cloud Functions or Dataflow for native querying; the stack uses Pub/Sub, Dataflow, GCS, BigQuery and BigQuery ML with DBT for modeling. It scales in tests to 10,000 requests per second (~300,000 peak CCU) and handled ~8.6 billion events per day with batching and client caching.
AI-written summary · about
chapters (3)
related talks
20mStreaming Processing Options in Google Cloud
55mCloud Analytics: from 0 to 100,000 events per second in 50'
30mData Warehouse in Google Cloud
40mFinOps Examples using Google Cloud BigQuery by Aliz.ai
26mETL pipeline with GCP Dataflow
41mReal-time Data Processing with Cloud Dataflow
48mUsing Open Source Tech to Swap Out Components of Your Data Pipeline
55mCloud services for gaming