Logging
Past Presentations
Forced Evolution: Shopify's Journey to Kubernetes
Shopify, in 2014, was one of the first large scale users of Docker in production. We ran 100% of our production web workers in hundreds of containers. We saw the value of containerization and aspired to also introduce a real orchestration layer. Fast forward two years to 2016, when instead we...
Canopy: Scalable Distributed Tracing & Analysis @Facebook
How do you understand the performance of a request that is executed in a large-scale system, potentially fanning out across thousands of machines and services? To answer this question at Facebook, we built a distributed tracing framework, Canopy, which has provided visibility into an otherwise...
Fast Log Analysis by Automatically Parsing Heterogeneous Log
Most log analysis tools provide platforms for indexing, monitoring, and visualizing logs. Although these tools allow users to relatively easily perform ad-hoc queries and define rules in order to generate alerts, they do not provide automated log parsing support. In particular, most of these...
Serverless Patterns and Anti-Patterns
Serverless has amazing potential to increase organizational agility and decrease operational costs, but realizing those benefits requires proper implementation. In this talk, we will cover the ideal patterns for serverless applications, anti-patterns for both greenfield applications and...
Interviews
Forced Evolution: Shopify's Journey to Kubernetes
What’s the focus of your work today?
I'm on the cloud platform team. Mostly I'm working with Kubernetes. The main goal is to make sure our platform for developers is working. That may mean that I'm debugging some issues with Docker or Kubernetes, or I’m writing Golang to automate the platform. Today, I'm actually working on improving our cluster life cycle, we are...
Read Full InterviewFast Log Analysis by Automatically Parsing Heterogeneous Log
Who is the main audience the talk is targeting?
The talk is mainly targeting people who design/architect log analytics solutions and are focused on making the troubleshooting operational problems faster by analyzing logs. When a computer operates, it generates logs to communicate with humans -- logs act as tweets to inform system status. If something fails, somebody has to...
Read Full InterviewServerless Patterns and Anti-Patterns
What’s the structure of this talk?
I strongly believe in getting the definition right and also talking about what I’m optimizing for. I will start with when I say serverless what do I mean. It’s about achieving business goals. It’s about not doing the undifferentiated heavy lifting. It’s about spending 95% (or more_ of your in-house developers time on...
Read Full Interview