Looking Under the Covers of StatsD

Intro StatsD is a network daemon that runs on the Node.js platform and listens for statistics, like counters and timers. Packets are then sent to one or more pluggable backend services. The default service is Graphite. Every 10 seconds the stats sent to StatsD are aggregated and forwarded on to this backend service. It can be useful to see what stats are going through both sides of the connection – from the client to StatsD and then from StatsD to Graphite. [Read More]

Percona Live 2012 – The Etsy Shard Architecture

I attended Percona Conf in Santa Clara last week. It was a great 3 days of lots of people dropping expert MySQL knowledge. I learned a lot and met some great people. I gave a talk about the Etsy shard architecture, and had a lot of good feedback and questions. A lot of people do active/passive, but we run everything in active/active master-master. This helps us keep a warm buffer pool on both sides, and if one side goes out we only lose about half of the queries until its pulled and they start hashing to the other side. [Read More]

Deployinator: Put a Button on it

I’ve been meaning to post more, but have been so busy lately at Etsy its been hard to find time. Going to get better at that! In the meantime, Erik Kastner and I just got back from OSCON and gave a talk about removing the cultural barriers that come as a result of unecessary process. We also open sourced the tool we use to deploy code over 30 times a day here on github [Read More]