As SoundCloud’s application and deployment architectures have evolved, so have the technologies we use to get requests and connections to where they need to be. Today, they support 175 million monthly active listeners and hundreds of thousands of requests per second – and are still built on readily available, open source components. This talk gives an overview of the techniques we use now and the background that they grew out of. It is not a comprehensive overview of all possible ways to do load balancing, but rather focuses on what works for us and how the pieces complement and complete each other. We will take a closer look at IPVS for Layer 4 connection load balancing, HAProxy for Layer 7 HTTP loadbalancing, with honorable mentions for ECMP and our service discovery mechanism. For each, we will see which use cases they excel in, when and how they break down, and what to watch out for so this doesn’t catch you by surprise.
Duration: 30:9
Publisher: LeaseWeb
You can watch this video also at the source.
