October 2007

MySQL Toolkit – Archiver

The MySQL Toolkit can be found at http://mysqltoolkit.sourceforge.net/. It is coded and maintained by Baron Schwartz (www.xaprb.com). I’ve been using the archiver tool he wrote lately, and wanted to share this tool. In every web environment I’ve worked in, there is data that is collected for analysis and that grows quite rapidly. User activity logs in particular can quickly grow out of control, and generally have no place in a front-end database after a certain amount of time.

The Prototype

The first start-up stage I’ve worked within is the prototype phase. Within this phase traffic is not an issue for performance or scale, it’s about functionality. Low traffic and small datasets can hide atrocious code quite easily. The nice thing about this stage is that you should not have to invest a lot of time or money into your database and instead can focus on functionality and business development. Over-engineering at this point can be a devastating waste of very precious resources.

The Start-up and the Database

My first senior production database role was at an established start-up, Preview Travel, that had just been purchased by a similarly established, but better positioned start-up, Travelocity. Since then, I’ve worked with start-ups in all stages of growth and I’ve seen definite patterns in how database infrastructures are designed, implemented and maintained (or the lack thereof). I’ve seen these phases of growth presented elsewhere, often at a level of granularity that didn’t work for me. I am a believer of simplicity wherever possible.

Preamble

I’ve been considering starting a blog of my own for quite some time, but I must admit to some hesitancy, primarily due to the quality of technical content already posted online. Finally, I’ve decided to take the plunge, and to focus on the quality I truly bring to my own customers. Yes, I possess a very solid technical acumen around Oracle and MySQL environments. But, it isn’t technical knowledge alone that can really bring a company to that desired nirvana of availability, performance and scalability, not to mention doing so on a reasonable budget.

Syndicate content
Website by Digital Loom