Building Sub-Second Latency Video Infrastructure at Cloudflare

Cloudflare has deployed a sub-second latency live streaming system at scale over the last few years. In this talk, we’ll provide insight on how this works under the cover, specifically focusing on protocols that Cloudflare Stream uses: HLS, DASH, RTMPS, SRT and WebRTC. In addition, we’ll talk about Cloudflare’s unique architecture that goes beyond the tools available to traditional content delivery networks like caching to distribute content at sub-second latency.

We will share our experiences and challenges in overcoming issues and enhancing the overall user experience in live streaming scenarios. We will explore the architectures and strategies we've developed to achieve sub-second live streaming - a critical goal in today's era of real-time communication and media such as:

Use of Real-Time Protocols: Cloudflare uses real-time protocols like WebRTC and SRT in facilitating low-latency communication, which facilitate lower latency and improved experience compared to common HTTP based protocols such as HLS and DASH.

Cloudflare’s network: Cloudflare uses a anycast network, which means that all clients connect to the closest of Cloudflare’s 285 locations. Even though this has some obvious latency benefits, it also comes with coordination challenges.

Edge Computing: By moving business logic to Cloudflare’s Workers platform and using edge-first primitives, Cloudflare Stream is able to improve experience for customers. We’ll talk about some of these primitives and how they compare to existing options when building low latency systems.

By the end of this talk you will have a deep understanding of the architecture, strategies, and practical considerations for building low latency live systems, and how Cloudflare’s systems work under the hood.


Date

Tuesday Jun 13 / 04:10PM EDT ( 50 minutes )

Location

Salon A-C

Topics

Platform Architecture CDN Video Media

Share

From the same track

Session Architecture

Using Traffic Modeling to Load-Balance Netflix Traffic at Global Scale

Tuesday Jun 13 / 10:35AM EDT

Netflix Infrastructure supports personalized UI and Streaming experience across 230M+ members around the world.

Speaker image - Niosha Behnam
Niosha Behnam

Staff Software Engineer @Netflix

Speaker image - Sergey Fedorov
Sergey Fedorov

Director of Engineering @Netflix

Session Architecture

Global Capacity Management through Strategic Demand Allocation

Tuesday Jun 13 / 01:40PM EDT

Meta currently operates in more than 15 data center regions around the world. This rapidly expanding global datacenter footprint poses new challenges for service owners as well as our infrastructure management systems.

Speaker image - Ranjith Kumar S
Ranjith Kumar S

Software Engineer @Meta

Session Architecture

From Open Source to SaaS: The Journey of ClickHouse

Tuesday Jun 13 / 05:25PM EDT

Have you ever wondered what it takes to go from an open-source project to a fully-fledged saas product? How about doing that in only 1 year’s time? If the answer is yes, then this talk is for you. You’ll hear straight from the experts who worked on the design, and execution of this huge project.

Speaker image - Sichen Zhao
Sichen Zhao

Senior Software Engineer @Clickhouse

Speaker image - Shane Andrade
Shane Andrade

Principal Software Engineer @ClickHouse

Session

Several Components are Rendering: Client Performance at Slack-Scale

Tuesday Jun 13 / 02:55PM EDT

Our users expect the interactions in our applications and websites to be fast, no matter how complicated they are under the hood. In this talk, we’ll explore some frontend performance issues encountered by Slack as they continue to grow and evolve the desktop app.

Speaker image - Jenna Zeigen
Jenna Zeigen

Staff Engineer @Slack

Session Architecture

Unconference: Architectures You've Always Wondered About

Tuesday Jun 13 / 11:50AM EDT

What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions.

Speaker image - Ben Linders
Ben Linders

Independent Consultant in Agile, Lean, Quality and Continuous Improvement