Posted by ChrisKennedy on December 21, 2006 at 1:16am
One thing I would be really interested in seeing is a benchmark suite run on the current drupal.org installation, and then again once it's upgraded to 5.0. Is this something that could be done or is being planned? It would be an underestimate of performance gains to the extent that certain performance patches are applied directly to d.o when fixed in core.
Performance upgrades from the CHANGELOG include:
- Improved session handling: reduces database overhead.
- Improved access checking: reduces database overhead.
- Made it possible to do memcached based session management.
- Omit sidebars when serving a '404 - Page not found': saves CPU cycles and bandwidth.
- Added an 'aggressive' caching policy.
- Added a CSS aggregator and compressor (up to 40% faster page loads).
There have also been numerous micro-level patches that optimize specific SQL queries or otherwise improve performance in certain situations. And a few other good performance fixes are still in the queue and may or may not make it into the 5.0 release.

Comments
Planned
It seems that the new memcache module has just appeared, a number of people are now looking at benchmarking. From IRC killes and I are going to sort out a benchmarking method/system. I came to g.d.o to create a group for this and found this group instead. So seems like a good place to discuss this.
--Andy
We didn't get around to do
We didn't get around to do any serious benchmarks.