Lessons learned building Storm
Storm is an open-source, distributed, realtime computation system. Storm is a multi-tenant system in which diverse and independent applications share the same resources on the cluster. Building Storm involved numerous challenges related to distributed systems, resource scheduling, resource contention, and capacity planning. We solved these problems by relying on a simple motto: the more complex the problem, the simpler the solution must be. In this talk you'll see what we learned building out Storm, both from a technical and process standpoint.
These lessons are hugely relevant to anyone working on complex systems or building out shared infrastructure.