Conference: Jun 26-28, 2017
Workshops: Jun 29-30, 2017
Presentation: A Microservice Based Architecture for Stream Processing using Spring Cloud Data Flow
Location:
- Williamsburg / Greenpoint
Duration
Day of week:
- Tuesday
Persona:
- Architect
- Developer
- Developer, JVM
Abstract
Developing an application based on a microservice style architecture bring several benefits. For example, individual microservice applications can be scaled and versioned independently from one another, written in different programming languages and managed by different teams.
While a microservices architecture is commonly applied to create distributed web applications communicating with each other using http, it can be similarly be applied for Stream processing applications that communicate using messaging middleware such as Kafka and RabbitMQ. Spring Cloud Data Flow enables you to orchestrate standalone executable applications to perform stream processing on a variety of runtimes, such as Apache YARN, Kubernetes, Apache Mesos, and PaaS platforms such as CloudFoundry through an extensible abstraction. Data Flow also provides a Unix style pipes and filters DSL that maps each ‘filter’ to executable , so “http | hdfs” represents a simple ingestion stream.
In this session we will create several standalone executable applications, run them via the command line to perform stream processing, and then deploy the distributed application via the DSL to multiple runtimes.
Similar Talks
Tracks
Monday, 13 June
-
Architectures You've Always Wondered About
Case studies from: Google, Linkedin, Alibaba, Twitter, and more...
-
Stream Processing @ Scale
Technologies and techniques to handle ever increasing data streams
-
Culture As Differentiator
Stories of companies and team for whom engineering culture is a differentiator - in delivering faster, in attracting better talent, and in making their businesses more successful.
-
Practical DevOps for Cloud Architectures
Real-world lessons and practices that enable the devops nirvana of operating what you build
-
Incredible Power of an Open-Sourced .NET
.NET is more than you may think. From Rx to C# 7 designed in the open, learn more about the power of open source .NET
-
Sponsored Solutions Track 1
Tuesday, 14 June
-
Better than Resilient: Antifragile
Failure is a constant in production systems, learn how to wield it to your advantage to build more robust systems.
-
Innovations in Java and the Java Ecosystem
Cutting Edge Java Innovations for the Real World
-
Modern CS in the Real World
Real-world Industry adoption of modern CS ideas
-
Containers: From Dev to Prod
Beyond the buzz and into the how and why of running containers in production
-
Security War Stories
Expert-level security track led by well known and respected leaders in the field
-
Sponsored Solutions Track 2
Wednesday, 15 June
-
Microservices and Monoliths
Practical lessons on services. Asks the question when and when to NOT go with Microservices?
-
Modern API Architecture - Tools, Methods, Tactics
API-based application development, and the tooling and techniques to support effectively working with APIs in the small or at scale. Using internal and external APIs
-
Commoditized Machine Learning
Barriers to entry for applied ML are lower than ever before, jumpstart your journey
-
Full Stack JavaScript
Browser, server, devices - JavaScript is everywhere
-
Optimizing Yourself
Keeping life in balance is always a challenge. Learning lifehacks
-
Sponsored Solutions Track 3