Presentation: Building and Operating a Serverless Data Pipeline

Track: Microservices / Serverless (Patterns & Practices)

Location: Broadway Ballroom North, 6th fl.

Duration: 1:40pm - 2:30pm

Day of week: Tuesday

Share this on:

Abstract

At Intent our machine learning platform processes real-time and historical data to predict user intent on billions of page views a month.  At the heart of this system is a serverless data pipeline that allows us to gather, process, store, and analyze data from disparate data sources.  In this talk, we’ll discuss the motivations of switching to a serverless infrastructure, and lessons learned while building and operating such a system at scale; focusing on operability, stability, scalability, and ease of development.

Speaker: Will Norman

Director Of Engineering at Intent

Will is a Director of Engineering at Intent where he leads the Data Platform team.  He has over 10 years of experience architecting, and building, high volume systems in the FinTech and AdTech industries.  These days Will is glad to be spending more time wrangling services than servers. Outside of tech he enjoys cooking, traveling, and spending time with his family.

Find Will Norman at

Tracks

Monday, 24 June

Tuesday, 25 June

Wednesday, 26 June