Conference: Jun 13-15, 2016
Tutorials: Jun 16-17, 2016
Presentation: New ETL Architecture and Building the World's Largest Cancer Database at Flatiron Health
Location:
- Salon D
Day of week:
- Friday
In this talk, Gil will share some of the principles and techniques used by Flatiron to build the nation’s largest cancer database. Flatiron Health’s platform connects cancer centers across the country on a common technology infrastructure, supporting treatment for about 1 in 5 active cancer patients in the U.S. Their architecture is focused on enabling rapid development iterations with cancer specialists, nurses, and other stakeholders. Rapidly integrating medical data from hundreds of heterogeneous source systems required Flatiron to develop a unique data integration and processing framework. Iterating quickly while incorporating knowledge from oncologists, nurses, medical informaticists, and healthcare analysts has largely shaped this architecture as well.
The talk will focus on tooling and the architecture that we built to support rapid iteration on complex ETL processes (iteration itself is quick) and minimizes knowledge translation iterations (number of iterations is smaller - we get stuff right with less iterations). The lessons taught here are on building architecture that optimally supports a business process or a unique development process and less about CS concepts like scalability, reliability etc.
Gil Shklarski Elsewhere
Similar Talks
Tracks
Wednesday Jun 10
-
Applied Data Science and Machine Learning
Putting your data to use. The latest production methods for deriving novel insights
-
Engineer Your Culture
Building and scaling a compelling engineering culture
-
Modern Advances in Java Technology
Tips, techniques and technologies at the cutting edge of modern Java
-
Monoliths to Microservices
How to evolve beyond a monolithic system -- successful migration and implementation stories
-
The Art of Software Design
Software Arch as a craft, scenario based examples and general guidance
-
Sponsored Solutions Track I
Thursday Jun 11
-
Emerging Technologies in Front-end Development
The state of the art in client-side web development
-
Fraud Detection and Hack Prevention
Businesses are built around trust in systems and data. Securing systems and fighting fraud throughout the data in them.
-
Reactive Architecture Tactics
The how of the Reactive movement: Release It! techniques, Rx, Failure Concepts, Throughput, Availability
-
Architecting for Failure
War stories and lessons learned from building highly robust and resilient systems
-
High Performance Streaming Data
Scalable architectures and high-performance frameworks for immediate data over persistent connections
-
Sponsored Solutions Track II
Friday Jun 12
-
Architectures You've Always Wondered about
Learn from the architectures powering some of the most popular applications and sites
-
Continuously Deploying Containers in Production
Production ready patterns for growing containerization in your environment
-
Mobile and IoT at Scale
Users, Usage and Microservices
-
Modern Computer Science in the Real World
How modern CS tackles problems in the real world
-
Optimizing Yourself
Maximizing your impact as an engineer, as a leader, and as a person
-
Sponsored Solutions Track III