Presentation: High Performance Cooperative Distributed Systems in Adtech
This presentation is now available to view on InfoQ.com
Watch video with transcriptAbstract
Typical large Adtech platforms handle 99th percentile response latency under 10ms and throughput in millions of requests per second while generating TBs of logs per day. Detection of invalid traffic (fabricated by bots) is fraught with many of the same engineering challenges to satisfy similar low-latency and high-throughput requirements. While an Adtech platform aspires to maximize ad relevancy, the goal of fraud detection is to minimize such invalid traffic. By design, both types of platforms are high-performance distributed systems that must cooperate to be successful.
In this talk, we will explore a set of core building blocks exhibited by Adtech platforms and apply them towards building a fraud detection platform. Our claim is by leveraging Cloud and OSS we can drastically reduce the time to production and infrastructure cost. Thus, bare-metal and proprietary software should no longer be deemed a barrier of entry.
After addressing performance, we will touch on the key attributes of system reliability and quality in an Adtech system. We will conclude with many insights learned from building one of the leading fraud detection platforms from the ground up.
Similar Talks
CockroachDB: Architecture of a Geo-Distributed SQL Database
CockroachDB maintainer, Co-founder & CTO @CockroachDB