Capstone: analytics for a streaming platform
A full interview on real-time analytics for a video streaming service: clarifying questions, a million events a second and a petabyte of data, the Kafka, Flink, Spark, ClickHouse and BigQuery architecture, the event envelope and regional ingestion, a trending score from unique viewers, late data from planes and subways with real-time, preliminary and final numbers, a star schema for creators, query layers, scaling 10 times, edge cases and monitoring.
01 · Previously
W08 · BOSS · Real-Time Analytics for Video Streaming Platform
Five days of analytics. One interview.
Previously: the query layer
Previously, on Day 5, you made the query layer fast: the right engine, rollups, caching with TTLs by freshness, and quotas per tenant.
0:00 / 19:30