cache router

My company recently launched a channel on msn.com -- yes, MSN has gone (partly) Drupal (a little bit)!

http://fitbie.msn.com/

This is a LAMP, PF 6.19 app with Cache Router (6.x-1.0-rc1) and multiple memcached bins, sitting behind Akamai. The home page is constructed in Panels (6.x-3.7).

We've had troubling recurrences of 404 home page responses. The symptoms look like this:

1. We get monitoring alarms that the home page is serving up 404 responses.
2. Apache httpd logs indicate 404s.
3. Watchdog indicates nothing.
4. Loading from our origin server looks good.

Hi Folks,

It was great seeing everyone last night. I hope you all had a good time.

I wanted to pick your brains about a topic I know we all love - scaling Drupal!

Spent A LOT of time over the past few days really getting into the bugs in Cache Router. This module is now entering the 1.0 release candidate world. It now "just works". For a lot of people it should be as easy as installing the module, adding the configs to settings.php and watching your site be 20-50% faster.

For bigger sites, this module will allow you to scale to great heights using memcache.

Here you go: 1.0-rc1 release - http://bit.ly/CMRRW Project page: http://drupal.org/project/cacherouter

Here is my initial post about performance tuning our site http://www.divx.com/ This is mainly a place for me to brain dump and spark discussion and hopefully open up issues to track and get some of these fixes into Drupal core.

Servers

4 - Web servers with 8GB Memory each, Apache 2.2.x + PHP 5.2.x
2 - Memcache Servers with 8 GB Memory each. 9 bins per server
2 - Database Servers with 16GB each running MySQL 5.0.x

Traffic