Home » Groups » High performance

Updating Site with huge DB to Drupal 6

gdtechindia's picture
Submitted by gdtechindia on Mon, 2009-10-12 19:55

Hi Everyone.

I have asked this earlier on forums as well, but didn't get any response.

Upgrading a website with around 200k nodes from Drupal 5.20 to 6.14

I read the drupal upgrade guide and i have tried with a test database.

But, the upgrade process doesn't complete. There are always some errors.

Also, should be upgrade happen in just one go, or it can be performed in different sub-sections.

Last time i ran update.php file, it was with url >> /update.php?op=start&id=7 which tells that it was seventh time. I guess this shouldn't cause any trouble ?

I have already spent 4 hours and the upgrade is still running.

Lets see how things finish.

Anyone having experience of upgrading a website with lot of nodes ? Its not only that the nodes are too many, they are big as well. Total DB size is usually 1.2 GB.

Groups:
High performance
Login to post comments

*_*

beautifulmind's picture
beautifulmind - Tue, 2009-10-13 04:59

The best way I could see is to write a db export/import script for the content. There are few fields are different in 6.x but most of the other columns are the same. Then you can have a clean installation of 6.x and import the db to your new site.

Regards.

:)
Beautifulmind


Login to post comments

Database settings

smk-ka's picture
smk-ka - Tue, 2009-10-13 17:07

The Drupal 6 upgrade changes/creates several database indexes on the node and related tables (taxonomy, if you use it). Thus, make sure you set aside LOTS of memory for MySQL's key cache (key_buffer_size), as this is where most of the work happens. Also, some queries run subqueries to update existing data, it might be possible to speed them up by delaying index generation. Example my.cnf entries:

key_buffer_size=512M
delay_key_write=ALL

--
Stefan Kudwien
unleashed mind


Login to post comments

I won't go in for solution

gdtechindia's picture
gdtechindia - Thu, 2009-10-15 16:00

I won't go in for solution suggested by beautifulmind as i am not aware what fields are changed during update. I would prefer to go by the actual update process rather than tweaking it.

And About Database Settings.

I tried to do it on a server with 4GB RAM and 4 Processor cores. This was a completely fresh server with only the database for update. Still things didn't work as expected. Mysql conf was optimized as well.

Has anyone performed a major update from drupal 5 to 6 on a website with large db ?

Thanks


Login to post comments

CSS Creator upgrade

taslett's picture
taslett - Thu, 2009-10-15 22:11

I just upgraded CSS Creator this month.
Make sure your PHP setting don't restrict the amount of memory available.
Disable all but core required modules and uninstall what you can.

The basic steps were posted here: http://csscreator.com/node/37356

http://csscreator.com


Login to post comments