warning icon QCon New York 2020 has been canceled. See our current virtual and in-person events.

DataEng

Past Presentations

ML Data Pipelines for Real-Time Fraud Prevention @PayPal

PayPal processes about a billion dollars of payment volume daily ($451bn in FY2017); complex decisions are made for each transaction or user action, to manage risk and compliance, while also ensuring good user experience. PayPal users can make payments immediately in 200 regions with the...

Mikhail Kourjanski Lead Data Architect, Risk and Compliance Management Platform @PayPal
Scaling DB Access for Billions of Queries Per Day @PayPal

As microservices scale and proliferate, they add increasing load on databases in terms of connections and resource usage. Open sourced in the Go programming language, Hera (High Efficiency Reliable Access to data stores) scales thousands of PayPal’s applications with connection...

Petrica Voicu Software Engineer @PayPal
Kenneth Kang Software Engineer @PayPal
Peloton - Uber's Webscale Unified Scheduler on Mesos & Kubernetes

With the increasing scale of Uber’s business, efficient use of cluster resources is important to reduce the cost per trip. As we have learned when operating Mesos clusters in production, it is a challenge to overcommit resources for latency-sensitive services due to their large spread of...

Mayank Bansal Staff Engineer @Uber
Apoorva Jindal Senior Software Engineer @Uber
Data Engineering Open Space

Details to follow.

Building and Operating a Serverless Data Pipeline

At Intent our machine learning platform processes real-time and historical data to predict user intent on billions of page views a month.  At the heart of this system is a serverless data pipeline that allows us to gather, process, store, and analyze data from disparate data sources....

Will Norman Director Of Engineering at Intent

Interviews

Petrica Voicu Software Engineer @PayPal Kenneth Kang Software Engineer @PayPal

Scaling DB Access for Billions of Queries Per Day @PayPal

What is the focus of your work today?

Petrica: I am working on developing Hera, which is High Efficiency Reliable Access to data sources, basically a proxy to databases. We support Oracle and MySQL. Hera helps PayPal scale.

Read Full Interview
Will Norman Director Of Engineering at Intent

Building and Operating a Serverless Data Pipeline

What is the focus of your work these days?

I'm the lead of the data platform team at Intent. Intent is a data science company that helps commerce sites maximize the value for each person who visits their site. Our main product is an ad network that runs on travel sites. On the data platform team we oversee our data pipeline, that collects data from ad servers and various...

Read Full Interview

Less than

0

weeks until QCon New York 2020

Registration is $3055.00 ($0 off) for the 3-day conference if you register before Dec 31st
SAVE YOUR SEAT

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.