Presentation: Probabilistic Programming from Scratch
Share this on:
This presentation is now available to view on InfoQ.com
Watch videoWhat You’ll Learn
- Gain a deeper understanding of how Probabilistic Programming can be used to help engineers solve problems around incomplete or partial data.
- Learn a new programming paradigm using Python and PyMC3.
- Hear how Probability Programming is being used in places like Facebook, Twitter, and Google in time series forecasting systems.
Abstract
This talk is for anyone who deals with real world data. Such data is always incomplete or imperfect in some way. Bayesian inference is a framework that allows us to draw conclusion from that data. And despite a reputation for mathematical and computational complexity, you don’t need a statistics background to understand Bayes at a conceptual level. We’ll develop that understanding by building a lightweight probabilistic programming system from scratch with simple Python. We’ll use the code we write to solve two real data problems: an A/B test and the German Tank problem. We’ll also look at how we’d solve those problems using PyMC3, a much more powerful, fully-featured probabilistic programming system.
What do you want someone to leave your talk with?
The audience will leave with a strong non-mathematical intuition for how Bayesian inference allows us to quantify the strength of conclusions drawn from real-world data. They’ll hopefully be excited to solve other toy problems with the tool we put together during the talk, and keen to check out PyMC3.
This talk is perhaps most useful for people who deal with real world data and face concrete statistical problems. But Bayesian inference provides a powerful day-to-day mental model for thinking about data and belief. And in keeping with the CS track, this talk will be an introduction to a new programming language paradigm for some. So I hope it will be at least interesting to a very wide audience!
Is probabilistic programming a real thing? Can you give me an example of where it's being used today?
Yes, it's a real thing! The most prominent examples of tech companies using these ideas in the real world are Facebook's Prophet time series forecasting system (which I'll discuss in the talk), and Uber's release of Pyro, an open source deep probabilistic programming system built on top of PyTorch. And Google are now getting involved with Tensorflow Probability
What is the level of experience someone attending this talk should have?
This might seem like a talk about statistics, mathematics and computer science. But my goal is that everyone who can write a for loop will understand everything we do. I attempt to ensure this by implementing things from scratch, and choosing a Bayesian inference algorithm that is particularly transparent and non-mathematical. I happen to use Python a little in this talk, but it's not essential that you can code in Python. And very importantly: no mathematics is required!
Similar Talks
Scaling DB Access for Billions of Queries Per Day @PayPal
Software Engineer @PayPal
Petrica Voicu
Psychologically Safe Process Evolution in a Flat Structure
Director of Software Development @Hunter_Ind
Christopher Lucian
Not Sold Yet, GraphQL: A Humble Tale From Skeptic to Enthusiast
Software Engineer @Netflix
Garrett Heinlen
Let's talk locks!
Software Engineer @Samsara
Kavya Joshi
PID Loops and the Art of Keeping Systems Stable
Senior Principal Engineer @awscloud
Colm MacCárthaigh
Are We Really Cloud-Native?
Director of Technology @Luminis_eu
Bert Ertman
The Trouble With Learning in Complex Systems
Senior Cloud Advocate @Microsoft
Jason Hand
How Did Things Go Right? Learning More From Incidents
Site Reliability Engineering @Netflix
Ryan Kitchens
Graceful Degradation as a Feature
Director of Product @GremlinInc
Lorne Kligerman
Tracks
Monday, 24 June
-
Architectures You've Always Wondered About
Hard earned lessons from names you know on scalability, reliability, throughput, and performance.
-
Modern CS in the Real World
Thoughts pushing software forward, including consensus, CRDTs, formal methods, & probabilistic programming.
-
Machine Learning for Developers
Machine learning is more approachable than ever. Learn techniques and use cases with PyTorch, Keras and TensorFlow that will become foundational for moderan application developers.
-
Developing/Optimizing Clients for Developers
Electron, Flutter, JavaScript, GraphQL, Node/NPM. Web Workers, Wasm, WebVR, Speech/Alexia/Pipeline. More topics than room in this modern UI tech track.
-
Human Systems: Hacking the Org
Innovative approaches to organizational leadership and management to build unique company cultures.
-
Speaker AMAs (Ask Me Anything)
Tuesday, 25 June
-
Microservices / Serverless (Patterns & Practices)
Evolving, observing, persisting, operating, and building modern architectures.
-
Modern Java Innovations
6 month cadence, cloud-native deployments, scale, Graal, Kotlin, and beyond. Learn how the role of Java as it is evolves for the next 20 years.
-
Data Engineering for the Bold
Explore the power of data systems & architectures
-
Non-Technical Skills for Technical Folks
Good engineers are great programmers. Amazing engineers are great collaborators.
-
Trust, Safety, & Security
Privacy, confidentiality, safety, security: Learnings from the frontlines
-
Speaker AMAs (Ask Me Anything)
Wednesday, 26 June
-
Architecting for Success when Failure is Guaranteed
More than just building software, building deployable production ready software in the face of guaranteed failure.
-
21st Century Languages
Lessons learned from building languages like Rust, Go-lang, Swift, Kotlin, and more.
-
Building High-Performing Teams
What “high-performing team” means and how to build one effectively depends on context. This track will share different experiences of building high-performing teams in order to highlight how different contexts lead to different solutions but also what typically stays the same because we’re still dealing with humans trying to work together. How do different forces affect the building of high-performing teams.
-
Software Defined Infrastructure: Kubernetes, Service Meshes, & Beyond
Deploying, scaling, managing your services is undifferentiated heavy lifting. Hear stories, learn techniques, and dive deep into software infrastructure.
-
High-Performance Computing: Lessons from FinTech & AdTech
Killing latency and getting the most out of your hardware.
-
Speaker AMAs (Ask Me Anything)