Shawn Gandhi
-
Analyzing Big Data On The Fly
Track: Modern Big Data SystemsLocation:Abstract:
Data is all around us. Whether it's log files generated from mobile and web applications, in-game player activity, or the deluge of information from trading floors, social apps, or geo-spacial monitoring. Collecting, analyzing, and responding to that data helps you stay in tune with your customers, business, and market trends. Analyzing your data while it's fresh allows you to react much quicker than the traditional end-of-day batch jobs we're often used to.
In this session, we’ll provide an overview of the key scenarios and business use cases suitable for real-time processing, and how developers are using AWS Kinesis to shift from a traditional batch-oriented approach to a continual real-time data processing model. We’ll explore the key concepts, APIs and features of the service in the context of building a Kinesis-enabled application for real-time processing. We’ll walk through a candidate use case in detail, starting from creating an appropriate Kinesis stream for the use case, configuring data producers to push data into Kinesis, and downstream applications that read from Kinesis to perform real-time processing.