Distributed Systems
Past Presentations
Chick-Fil-A: Milking the Most Out of 1000's of K8s Clusters
Last year, I shared about how Internet of Things and Edge Compute are providing a new platform for Chick-fil-A to transform its in-restaurant operations, from the customer experience to kitchen automation. At that time, we were running Docker Swarm to manage our container-based microservices at...
Forced Evolution: Shopify's Journey to Kubernetes
Shopify, in 2014, was one of the first large scale users of Docker in production. We ran 100% of our production web workers in hundreds of containers. We saw the value of containerization and aspired to also introduce a real orchestration layer. Fast forward two years to 2016, when instead we...
Efficient Fault Tolerant Java with Aeron Clustering
Distributed systems present a number of challenges. Node failure, unreliable networks, resource starvation, and even the unpredictability of time itself can, and do, make our systems complex and fragile. We deserve and can do better. In this session, we will talk about Aeron Clustering, a new...
Canopy: Scalable Distributed Tracing & Analysis @Facebook
How do you understand the performance of a request that is executed in a large-scale system, potentially fanning out across thousands of machines and services? To answer this question at Facebook, we built a distributed tracing framework, Canopy, which has provided visibility into an otherwise...
Modeling the Real World With Elixir/OTP
Building software that interacts with the real world is not as trivial as it sounds. When you build software that interacts with the real world, you have model your program to represent the real world. The traditional approach to modeling this is to model real-world events sequentially, one after...
Next Gen Networking Infrastructure With Rust
As the world becomes ever more connected, the scale and sophistication of network infrastructure software is increasing dramatically. However, the requirements for this software are as stringent as ever: it must not only be fast, it must be safe, i.e. able to process untrusted data without...
Interviews
Chick-Fil-A: Milking the Most Out of 1000's of K8s Clusters
How does the Kubernetes implementation at Chick-Fil-A differ from more common approaches to Kubernetes deployments?
Brian: Most of the people that we see in the industry that are running Kubernetes clusters at any kind of scale (or really running and big container platforms) generally have a cloud-based infrastructure that they run in AWS (or Google). Most companies have a single or a few sizeable Kubernetes clusters with a large number of nodes (on...
Read Full InterviewForced Evolution: Shopify's Journey to Kubernetes
What’s the focus of your work today?
I'm on the cloud platform team. Mostly I'm working with Kubernetes. The main goal is to make sure our platform for developers is working. That may mean that I'm debugging some issues with Docker or Kubernetes, or I’m writing Golang to automate the platform. Today, I'm actually working on improving our cluster life cycle, we are...
Read Full InterviewModeling the Real World With Elixir/OTP
What is the focus of your work today?
I work on event-based systems that leverage Elixir/OTP and quite a bit of Apache Kafka. My team is building a platform for enriching and processing high volumes of data in real time.
Read Full InterviewSeamlessly Migrating To Serverless with 80-Million Users
Is your talk a story of a migration to a serverless architecture through a devops lens or maybe are you talking about practices and patterns for serverless? What's the angle that you're taking with your talk?
I'm starting with just building a little bit of a foundation for what I feel devops actually is. There's a lot of charts about like the process project creation, packaging, releasing, and monitoring in a serverless world. Then start talking about devops for us.
Read Full InterviewDigital Publishing for Scale: The Economist and Go
Would you describe your work at The Economist?
I am the lead engineer for the content platform team at The Economist. We deliver content to different products within The Economist (as well as to our external consumers). Our team is responsible for adding new features to the content platform thereby helping the business build new products.
Read Full InterviewHeretical Resilience: To Repair is Human
Tell me a bit about the work that you do today.
I'm currently working at Travis CI where I'm the lead of the build environment team. This team is working on the environment that allows our customers to run their builds - making sure that we can create, test, and update the environments where customer builds get run in a reliable manner, so that customers can continue to test as new...
Read Full Interview