Distributed Systems
Presentations
High Performance Cooperative Distributed Systems in Adtech
Typical large Adtech platforms handle 99th percentile response latency under 10ms and throughput in millions of requests per second while generating TBs of logs per day. Detection of invalid traffic (fabricated by bots) is fraught with many of the same engineering challenges to satisfy...
Past Presentations
No Microservice Is an Island
You don't deploy a single microservice. The journey to microservice architecture involves more than how code is written or applications are packaged. It's about creating an interconnected ecosystem that keeps things running. Infrastructure and tools have only grown in importance as microservices...
Chick-Fil-A: Milking the Most Out of 1000's of K8s Clusters
Last year, I shared about how Internet of Things and Edge Compute are providing a new platform for Chick-fil-A to transform its in-restaurant operations, from the customer experience to kitchen automation. At that time, we were running Docker Swarm to manage our container-based microservices at...
Forced Evolution: Shopify's Journey to Kubernetes
Shopify, in 2014, was one of the first large scale users of Docker in production. We ran 100% of our production web workers in hundreds of containers. We saw the value of containerization and aspired to also introduce a real orchestration layer. Fast forward two years to 2016, when instead we...
Interviews
No Microservice Is an Island
You worked at Capital One first and then switched over to Square. So what were you working on at Capital One?
At Capital One, I was working on the first layer of services that our mobile app and website hit. Any new mobile or web request would first reach the service owned by my team. This service implemented security and customisation logic and then made a server request to the broader Capital one ecosystem. Capital One has a lot of...
Read Full InterviewChick-Fil-A: Milking the Most Out of 1000's of K8s Clusters
How does the Kubernetes implementation at Chick-Fil-A differ from more common approaches to Kubernetes deployments?
Brian: Most of the people that we see in the industry that are running Kubernetes clusters at any kind of scale (or really running and big container platforms) generally have a cloud-based infrastructure that they run in AWS (or Google). Most companies have a single or a few sizeable Kubernetes clusters with a large number of nodes (on...
Read Full InterviewForced Evolution: Shopify's Journey to Kubernetes
What’s the focus of your work today?
I'm on the cloud platform team. Mostly I'm working with Kubernetes. The main goal is to make sure our platform for developers is working. That may mean that I'm debugging some issues with Docker or Kubernetes, or I’m writing Golang to automate the platform. Today, I'm actually working on improving our cluster life cycle, we are...
Read Full InterviewModeling the Real World With Elixir/OTP
What is the focus of your work today?
I work on event-based systems that leverage Elixir/OTP and quite a bit of Apache Kafka. My team is building a platform for enriching and processing high volumes of data in real time.
Read Full InterviewSeamlessly Migrating To Serverless with 80-Million Users
Is your talk a story of a migration to a serverless architecture through a devops lens or maybe are you talking about practices and patterns for serverless? What's the angle that you're taking with your talk?
I'm starting with just building a little bit of a foundation for what I feel devops actually is. There's a lot of charts about like the process project creation, packaging, releasing, and monitoring in a serverless world. Then start talking about devops for us.
Read Full InterviewDigital Publishing for Scale: The Economist and Go
Would you describe your work at The Economist?
I am the lead engineer for the content platform team at The Economist. We deliver content to different products within The Economist (as well as to our external consumers). Our team is responsible for adding new features to the content platform thereby helping the business build new products.
Read Full Interview