(Q)Installing Aegir 0.4 alpha 9 (soon to be alpha 10) over Mercury/Pantheon(1.1 beta) at Linode on Ubuntu 10.04(Lucid)

Events happening in the community are now at Drupal community events on www.drupal.org.
MacRonin's picture

Hello all,

First thank you for all the work that has been put into Aegir and Mercury/Pantheon. I've been keeping an eye on both for a while and am ready to jump in. While my needs aren't heavy ... yet. A current project has the potential to need the power and scalability of Mercury/Pantheon and I want Aegir to make life simpler for implementing new sites and creating test development environments. So with that in mind I am creating a new server at Linode and will be migrating my sites(mostly D6 with one D5) from my old standard server.

Since I am converting from a box that wasn't using Apache/Solr, had no reverse proxy(Varnish) or caching such as APC/memcached in place I don't have to have those options fully in place on day one. I can activate those as I get a handle on their unique twists due to multi-site on Mercury/Pantheon. But I do want to lay the groundwork and get as much in place up front as I can.

I have been reading everything I can find(I'll include some of the links at the end of this post), which has answered many of my questions. But has also lead to a few more detailed new ones.

  • Installing new VPS at Linode with Ubuntu 10.04(Lucid, php downgraded to 5.2), Mercury/Pantheon(1.1 beta)

1 - Starting assumptions:

1.01 -- I want php 5.2 and not Lucid's default 5.3 for compatibility on Drupal 6, Plus possibly one old drupal 5 site.
1.02 -- I want MySQL 5.1, but may evaluate MariaDB at some point in the future.
1.03 -- VPS will be at Linode and 1 gig(1024meg) of RAM
1.04 -- Mercury/Pantheon 1.0 is current stable but 1.1 is late? beta. (Not sure how close to release, but sounds kinda close so hopefully reasonably stable)
http://www.linode.com/stackscripts/view/?StackScriptID=353 <-- Mercury/Pantheon(1.0) 400+ deployed but 100 still active
http://www.linode.com/stackscripts/view/?StackScriptID=701 <-- for Mercury/Pantheon(1.1 beta) only 6 deployed and zero still active ?
http://groups.drupal.org/node/70268 <-- Step-by-step: Installing Project Mercury 1.1 (Beta) on Ubuntu Lucid
1.05 -- Aegir 0.3 is current stable, but 0.4 alpha9 is most current development release. alpha 10 coming shortly due to bug found
1.06 -- Following items will require extra handling beyond the base installs
1.06.1 -- switch from php 5.3 down to php 5.2
1.06.2 -- setup of global.inc to include additional info in settings.php(can't edit direct since aegir refreshes settings.php file) to handle multi-site caching for APC and memcache?
# Key Prefix: edit this for multisite use.
$conf['memcache_key_prefix'] = 'site2';
using a variable containing site name/path? has been mentioned for prefix(trying to find msg again)
-1.07 -- modification of Apache Solr config? to handle multi-sites.
http://groups.drupal.org/node/77883
http://davehall.com.au/blog/dave/2010/06/26/multi-core-apache-solr-ubunt...
This may also come in handy, but still investigating.
http://developmentseed.org/blog/2010/may/27/searchlight-views-driven-app...

2 - Some outstanding questions / OK maybe average questions, but still looking for answers :-)

2.01 - As part of the Aegir install it says to make sure that certain basic packages are in place prior to running the install script. Will the Mercury/Pantheon(1.1 beta) install be taking carte of any of these requirement? If not in place, I'm thinking hat rerunning the install won't cause problems except for maybe php(since 5.3 > 5.2)
2.02 - Does the Mercury/Pantheon(1.1 beta) install also down grade php from 5.3 to 5.2 on Ubuntu Lucid? I am assuming that it doesn't and that I will be handling that manually. I ask, because a single post implied that Mercury install took care of this, but that might have only been on Amazon AMI's
2.03 - I know that some variation of Aegir and Mercury/Pantheon have been run together, but was wondering if anyone has the specific combination of Mercury/Pantheon(1.1 beta) and Aegir 0.4 alpha 9? Even better if they are running it at Linode.
2.04 - Any other reasons to do a 64bit server vs a 32 bit one beyond the ability to access over 4 gig of RAM? Any downsides for 64bit over 32 bit? I considering going for the 64 bit in case project takes off and I need the RAM.
2.05 - Cacherouter ( http://drupal.org/project/cacherouter ) I've seen a comments that says it works out of the box with APC+Aegir, anyone know if it can handle memcached+Aegir also? Don't see anything in it's issue queue
2.06 - I'm guessing that the non-stackscript method is probably the best choice for installing Mercury/Pantheon. http://groups.drupal.org/node/70268

3 - Some misc links other may find usefull:

http://groups.drupal.org/node/72488 <-- Instructions for setting up multi-site on Mercury
http://groups.drupal.org/node/55033 <-- Mercury + Aegir
http://groups.drupal.org/node/55393 <-- Says has bugs that cause Aegir failure(has it been fixed?) / Install Aegir In Mercury - New Installation (also oriented towards Amazon EC2 and AMIs)
http://groups.drupal.org/node/73463 <-- Proper way to make Cacherouter-APC, Boost work with Aegir
http://groups.drupal.org/node/84639 <-- Aegir integration with Pantheon/Mercury (Maybe someday ...)
http://groups.drupal.org/node/58838 <-- Mercury Multisite?
http://groups.drupal.org/node/70268 <-- Step-by-step: Installing Project Mercury 1.1 (Beta) on Ubuntu Lucid
http://groups.drupal.org/node/70258 <-- Mercury's Template system for BCFG2
http://drupal.org/node/500088#comment-2457592 < -- allow user-defined settings.php overrides / global.inc
http://drupal.org/node/500088#comment-2074578 < -- site specific if file to be included exists.

http://groups.drupal.org/node/50408 <-- Step-by-step: Setting up Project Mercury 1.0 (Varnish, Apache, APC, Memcached and Solr) using BCFG2
http://groups.drupal.org/node/84074 < -- Barracuda Aegir with Nginx Edition 0.4-alpha9-A9.F (Lucid, Karmic and Lenny compatible)

Any info/feedback appreciated.
Paul

Comments

Subscribing

zkrebs's picture

Very interested in hearing more about the PHP 5.2 vs 5.3 question, and if anyone is using http://www.linode.com/stackscripts/view/?StackScriptID=701

Core is pretty much 5.3

brianmercer's picture

Core is pretty much 5.3 compatible, but many contrib modules are not. I use 5.3 and I have a folder filled with about 12 patches, gathered from various contrib module issue queues, that need to be applied to various modules. You load a module, start getting warning messages, check the issue queues and usually someone has posted a patch.

Man I am somewhere in the

3rdLOF's picture

Man I am somewhere in the middle on this one. In one hand, downgrading to eventually upgrade is a pain, but the inter-module bugs across a large system can kill your deadlines.

is it possible to run

spacereactor's picture

is it possible to run Mercury/Pantheon(1.1 beta) http://www.linode.com/stackscripts/view/?StackScriptID=701 but with Linode cheapest plan 512mb RAM?

re: is it possible to run

Greg Coit's picture

Yes, however 512mb RAM is the minimum Mercury/Pantheon is deisgned to run on.

Greg

--
Greg Coit
Systems Administrator
http://www.chapterthree.com

Greg Coit's picture

1.01 -- I want php 5.2 and not Lucid's default 5.3

Pantheon 1.1 replaces 5.3 with 5.2 for compatibility with the drupal modules that don't yet support 5.3

1.02 -- I want MySQL 5.1, but may evaluate MariaDB at some point in the future.

At the moment, Mercury/Pantheon only support MySQL out of the box

1.03 -- VPS will be at Linode and 1 gig(1024meg) of RAM

That's a good place to start - Mercury/Pantheon is designed for a minimum of 512.

1.04 -- Mercury/Pantheon 1.0 is current stable but 1.1 is late? beta.

1.1 is working and stable but has not been officially released because we've been adding even more features and the next stable release will likely be 1.2 (1.1 will likely stay in beta).

1.05 -- Aegir 0.3 is current stable, but 0.4 alpha9 is most current development release. alpha 10 coming shortly due to bug found

Sorry, can't speak to the status of Aegir.

1.06.1 -- switch from php 5.3 down to php 5.2

Mercury/Pantheon 1.1 will do this for you.

1.06.2 -- setup of global.inc to include additional info in settings.php(can't edit direct since aegir refreshes settings.php file) to handle multi-site caching for APC and memcache?
# Key Prefix: edit this for multisite use.
$conf['memcache_key_prefix'] = 'site2';
using a variable containing site name/path? has been mentioned for prefix(trying to find msg again)

Please let us know if you find this - I'm sure others will be interested.

1.07 -- modification of Apache Solr config? to handle multi-sites.

Apache Solr is configure for multi-site in Mercury/Pantheon 1.1. However, the links you list should indicate what needs to be added when a new site is rolled out.

2.01 - As part of the Aegir install it says to make sure that certain basic packages are in place prior to running the install script. Will the Mercury/Pantheon(1.1 beta) install be taking carte of any of these requirement? If not in place, I'm thinking hat rerunning the install won't cause problems except for maybe php(since 5.3 > 5.2)

http://groups.drupal.org/aegir-hosting-system says that Aegir "has the same base requirements that Drupal does" which makes me think that Mercury/Pantheon installs all the packages that Aegir needs. Since we pin PHP 5.2, Aegir would be unable to install PHP 5.3 (and will use the 5.2 that's installed)

2.02 - Does the Mercury/Pantheon(1.1 beta) install also down grade php from 5.3 to 5.2 on Ubuntu Lucid? I am assuming that it doesn't and that I will be handling that manually. I ask, because a single post implied that Mercury install took care of this, but that might have only been on Amazon AMI's

It does take care of this.

2.06 - I'm guessing that the non-stackscript method is probably the best choice for installing Mercury/Pantheon. http://groups.drupal.org/node/70268

At this point, if you want to use Mercury/Pantheon 1.1, I would use the install docs (which I think are slightly more up to date): http://groups.drupal.org/node/70268.

Hope this helps,

Greg

--
Greg Coit
Systems Administrator
http://www.chapterthree.com

Thanks for details

MacRonin's picture

Greg, Thanks for the details.

Glad to hear the confirmations that with Mercury/Pantheon 1.1 PHP does get downgraded to 5.2 and that 1.1beta is an "almost" stable and looking forward to 1.2

Installation order or how to integrate the installs

3rdLOF's picture

Does it matter the order in which this should be attempted? Should it be Mercury > Aegir or Aegir > Mercury or does even make a difference?

I have a clean copy of a manually installed Mercury 1.0 on Ubuntu 10.4 LTS and I have been trying to use these instructions to get Aegir:

http://groups.drupal.org/node/55393

which are for an AMI but that I presume only need it to be modified for the Aegir webroot, which in a Linode would be /var/aegir instead of /vol/aegir, so

echo "Include /var/aegir/config/apache.conf" > /etc/apache2/conf.d/aegir

It all appears to go smoothly (except for the binding issue with the Mysql configuration, which must be commented on the mysql configuration file before running the install script) and the agnostic install script for alpha14 http://git.aegirproject.org/?p=provision.git;a=blob_plain;f=install.sh.t...
goes through with only some minor warnings (which are the missing configuration folders it then makes)

From this point on I am at a lost as of these two come together.

Any tips would be highly appreciated.

Trouble Installing Step#4 (Ubuntu 10.04(Lucid))

leandroman's picture

I am following instructions from: http://groups.drupal.org/node/70268
Step 1 - 3 worked well.

This is the output from Step #4 (numbered for ease of reference)
Step #4 Command: sudo /etc/init.d/bcfg2-server start; sudo tail -f /var/log/syslog
Step #4 Output:

01. Starting Configuration Management Server:  * bcfg2-server
02. Jan 15 03:15:36 Production03 init: plymouth-splash main process (646) terminated with status 2
03. Jan 15 03:15:36 Production03 bcfg2-server[588]: Handled 75 events in 0.029s
04. Jan 15 03:15:36 Production03 bcfg2-server[588]: Handled 134 events in 0.141s
05. Jan 15 03:15:36 Production03 bcfg2-server[588]: Handled 39 events in 0.092s
06. Jan 15 03:15:38 Production03 ntpdate[654]: step time server 91.189.94.4 offset 0.000063 sec
07. Jan 15 03:15:43 Production03 kernel: [   13.150057] eth1: no IPv6 routers present
08. Jan 15 03:15:44 Production03 kernel: [   13.980061] eth0: no IPv6 routers present
09. Jan 15 03:17:00 Production03 bcfg2-server[588]: serve_forever() [stop]
10. Jan 15 03:17:00 Production03 bcfg2-server[588]: server_close()
11. Jan 15 03:19:01 Production03 CRON[817]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
12. Jan 15 03:20:23 Production03 bcfg2-server[872]: Packages: Failed to read configuration file: [Errno 2] No such file or directory: '/var/lib/bcfg2/Packages/sources.xml'  Have you created it?
13. Jan 15 03:20:23 Production03 bcfg2-server[872]: Failed to instantiate plugin Packages
14. Jan 15 03:20:23 Production03 bcfg2-server[872]: Failed to read file probed.xml
15. Jan 15 03:20:23 Production03 bcfg2-server[872]: service available at https://Production03:6789
16. Jan 15 03:20:23 Production03 bcfg2-server[872]: serving bcfg2-server at https://Production03:6789
17. Jan 15 03:20:23 Production03 bcfg2-server[872]: serve_forever() [start]
18. Jan 15 03:20:23 Production03 bcfg2-server[872]: Handled 76 events in 0.022s
19. Jan 15 03:20:23 Production03 bcfg2-server[872]: Handled 63 events in 0.016s
20. Jan 15 03:20:23 Production03 bcfg2-server[872]: Handled 171 events in 0.173s
21. Jan 15 03:20:23 Production03 bcfg2-server[872]: Handled 27 events in 0.012s

What am I doing wrong here?

To help out with my trouble, Here is a copy of my /var/lib/bcfg2 directory. I also include what my /etc/bcfg2.conf file looks like.
www.leandrolima.com/bcfg2-files.zip

Lastly, I didn't recognize there was any trouble with this part of the installation, except that it went very quickly (a few seconds) and the instructions said it would take a while...

I kept on marching with the steps 5 + 6. When I tried to install Drush, I got an error saying PHP was not installed. That's when I knew something had gone terribly wrong. I assume it's with step #4.

I appreciate any help anyone can offer. I did everything I could to make it easy for someone more knowledgeable to help.

Thanks.

-
LeandroMan

Aegir hosting system

Group organizers

Group categories

Group notifications

This group offers an RSS feed. Or subscribe to these personalized, sitewide feeds: