Learn how Weaveworks monitors clusters of containers at scale using a highly available, multi-tenant system built on AWS. Learn more at – http://amzn.to/2Bp4tTv.
Metrics are forwarded to their system and, via a consistent hash ring implemented using Consul, routed to a set of three ingesters chosen from a larger, dynamically scaled pool. Metrics are buffered in the ingester (an EC2 instance) and then stored in a DynamoDB table, along with 9 or 10 indexes. The buffering results in write deamplification, reducing costs and increasing scalability.
Host: Jeff Barr, Director AWS Evangelism
Speakers: Jonathan Lange, VP of Engineering
Publisher: Amazon Web Services
You can watch this video also at the source.