Ephemeral processes like containers are increasingly being used to build and run applications because of their isolation, portability, and efficiency. But they're often bogged down by data gravity when handling data-intensive applications. If a process is executing only for a short time in isolation, how can it consume and produce data from and to a variety of locations, beyond the bounds of just databases?
In this talk, we will use Tekton as a case study to explore challenges of data gravity in ephemeral execution. Tekton is an orchestration engine for CI/CD that executes arbitrary user-supplied workloads as containers on Kubernetes. Tekton workloads need to securely consume data (such as source code) and produce data (such as binary artifacts), while avoiding limitations of the underlying architecture. To address these challenges, Tekton is exploring approaches including clean container injection mechanisms for backing immutable artifacts, and a secure server interface between orchestrating controllers and user-specified workloads for communicating trusted metadata.
Learn how to effectively use ephemeral processes to build and run data-intensive applications.
Senior Software Engineer @Google
Jerop Kipruto is a Senior Software Engineer at Google and a maintainer of the Tekton project, where she works on making it easier and fun for developers to build and ship cloud native applications. She holds a B.Sc. in Electrical Engineering and Computer Science from Massachusetts Institute of Technology. Jerop is also a frequent speaker at industry conferences, including the Linux Foundation Member Summit, Continuous Delivery Conference, Open Source Summit, and Google DevFest. Outside of work, she enjoys staying active and reconnecting with her Kenyan roots through running.
Software Engineer @Google
Christie Warwick (Wilson) (she/her) is a software engineer with a passion for building quality software and having fun doing it. During her career she has worked on everything from currency exchange to AAA games.
Currently, she builds continuous delivery tools at Google, where she is proud to have co-created Tekton: an open-source continuous delivery platform built on Kubernetes. She is the author of Grokking Continuous Delivery and a speaker at Kubecon, InfoQ, OSCON and more. In her spare time she influences company culture through cat pictures.