Case Study: Weaveworks achieves scalable cluster monitoring with HashiCorp Consul

Weaveworks Cluster Monitoring at Scale, with Consul

Weaveworks needed a way to monitor highly available, multi-tenant container clusters at scale. Working with HashiCorp and its Consul service, the team set out to manage cluster monitoring reliably as their environment and traffic grew.

Using HashiCorp Consul, Weaveworks implemented a consistent hash ring to receive metrics and route them to three randomly selected ingesters from a dynamically scaled pool. The ingester buffered data through an EC2 instance and stored it in DynamoDB with several indexes, de-amplifying writes to reduce costs and improve scalability.

Weaveworks

Jonathan Lange

Vice President of Engineering