Making the internet a better place: Scaling AppNexus
Our mission is to make the internet a better place. We help content producers like news, social, and gaming sites monetize better, and we help users discover new products and services. In order to achieve this goal, our entire business depends on data, reliability, and speed. The past three years weve experienced 'hold on for dear life!' growth, and this presentation will give an uncensored dive into our architecture and lessons weve learned along the way. In particular, well dig into the buy vs build connundrum, with a focus on: Our data pipeline and our transition from out of the box to the horizontally scalable Hadoop; our load balancer-free DNS architecture built in GSLB and Keepalived; our real-time data streaming infrastructure, built primarily in C and processing 30 terabytes of data every day.