You are viewing content from a past/completed QCon

Presentation: High Performance Cooperative Distributed Systems in Adtech

Track: High-Performance Computing: Lessons from FinTech & AdTech

Location: Soho Complex, 7th fl.

Duration: 2:55pm - 3:45pm

Day of week: Wednesday

Share this on:

This presentation is now available to view on InfoQ.com

Watch video with transcript

Abstract

Typical large Adtech platforms handle 99th percentile response latency under 10ms and throughput in millions of requests per second while generating TBs of logs per day. Detection of invalid traffic  (fabricated by bots) is fraught with many of the same engineering challenges to satisfy similar low-latency and high-throughput requirements.  While an Adtech platform aspires to maximize ad relevancy, the goal of fraud detection is to minimize such invalid traffic. By design, both types of platforms are high-performance distributed systems that must cooperate to be successful.  

In this talk, we will explore a set of core building blocks exhibited by Adtech platforms and apply them towards building a fraud detection platform. Our claim is by leveraging Cloud and OSS we can drastically reduce the time to production and infrastructure cost.  Thus, bare-metal and proprietary software should no longer be deemed a barrier of entry.  

After addressing performance, we will touch on the key attributes of system reliability and quality in an Adtech system. We will conclude with many insights learned from building one of the leading fraud detection platforms from the ground up.

Speaker: Stan Rosenberg

VP of Engineering @Forensiq

Stan Rosenberg is a passionate software engineer, leader and scientist; he holds a Ph.D. in Computer Science from Stevens Institute of Technology.  He currently heads up engineering at Forensiq--a leading fraud detection platform for online advertising.  Prior to Forensiq, he built distributed platforms for startups.  His Ph.D. dissertation explored formal methods of software verification by leveraging "local reasoning" in conjunction with decision procedures.  Stan revels in all challenges at the intersection of software engineering, research and leadership.

Find Stan Rosenberg at

Tracks

  • Devex & Teams

    Explore how to reduce developer friction between teams and stakeholders.

  • Blameless Culture

    Absorb the lessons learned from failures and outages in a human-centric process.

  • Modern CS in the Real World

    Learn how companies are applying recent CS research to tackle concurrency, distributed data, and coordination.

  • Architectures You’ve Always Wondered About

    Next-gen architectures from the most admired companies in software.

  • Bare Knuckle Performance

    Learn from practitioners on the challenges and benefits of architecting for performance and much more.

  • Java - The Interesting Bits

    Learn the new features in the recent and near-future releases of Java and the JVM and what they offer.

  • Ethical Considerations in Consciously Designed Software

    Design considerations for various contexts, locations, security and privacy requirements.

  • Operating Microservices

    Learn from practitioners operating and evolving systems in performance demanding environments.

  • Security

    Learn how to make security an inherent part of the software development process.

  • Native Compilation Is Back (A Look at Non-Vm Compilation Targets)

    Issues with native compilation for in browser-based and server-side environments

  • Trouble-Shooting in Production

    Learn debugging strategies for complex and high stakes environments where standard debuggers and profilers fail.

  • Predictive Architectures and ML

    Explore the systems and designs covering the full loop from machine learning to inferencing.

  • Data Engineering on the Bleeding Edge

    Explore the latest trends in data engineering that help improve the life of the developer

  • Production Readiness

    Observability, emergency response, capacity planning, release processes, and SLOs for availability and latency.

  • Humane Leadership

    A look at leadership with an emphasis on empathy, taking chances and building other leaders within organizations and teams