Weaveworks Cluster Monitoring at Scale


Learn how Weaveworks monitors clusters of containers at scale using a highly available, multi-tenant system built on AWS. Learn more at – http://amzn.to/2Bp4tTv.

Metrics are forwarded to their system and, via a consistent hash ring implemented using Consul, routed to a set of three ingesters chosen from a larger, dynamically scaled pool. Metrics are buffered in the ingester (an EC2 instance) and then stored in a DynamoDB table, along with 9 or 10 indexes. The buffering results in write deamplification, reducing costs and increasing scalability.

Host: Jeff Barr, Director AWS Evangelism
Speakers: Jonathan Lange, VP of Engineering


Duration: 4:33
Publisher: Amazon Web Services
You can watch this video also at the source.


Furlow consulting