Blog

Sarah Sproehnle is an excellent speaker, so I was excited to see her speak about Hadoop, which I know very little about...so here's the liveblogging:

Hadoop is an "open source framework for storing and processing data on a cluster of computers."  Processing is key -- analysis of data.

About six weeks ago I posted about leaving Pythian. I had a month off in which I spent quality time with my husband, including packing up our apartment to move two blocks away. I also spent some time doing some planning and organizing for OpenSQLCamp Boston, happening in 6 weeks. Many people have been wondering what my next move is.

I’ve been setting up partitioning for various customers lately. The goals primarily have been easy purging of large growth tables and keeping indexes small enough to stay in memory and manageable. These have all been range partitions on dates, which is a rather common requirement. As you’ve probably noticed in previous posts, I absolutely hate environments where people let their tables grow like blackberry bushes. While doing research, I found the following links to be very helpful:

http://dev.mysql.com/tech-resources/articles/testing-partitions-large-db.html

Everyone puts lip service to the concept of keeping versions consistent between servers but it is consistently one of the most broken best practices I see amongst my clients. The problems with such inconsistency are legion, and I’ll point out a few here.