Platform will not verify on Remote server

I'm starting to think that these are a red herring:
Initialized Drupal 6.16 root directory at /var/aegir/platforms/drupal-6.16
Could not find a Drupal settings.php file at ./sites/default/settings.php.

And that my real problem is:
The drush command 'provision-verify' could not be found.

I have provision loaded in /var/aegir/.drush/provision with all the correct permissions but it does not seem to be finding it when aegir runs the remote ssh command. Stumped.

From the command line on the server running the aegir frontend do an 'su - aegir' and run the verify with the --debug switch like this:

Post your output here.

Do you plan to run mysql on the remote webserver where this platform is installed?

Trying to set up a pressflow platform on a remote server, I received the following errors when it failed to verify.
I do want to run mysql on the remote webserver where this platform is installed and the key pairs seem to be working fine.

Drush bootstrap phase : _drush_bootstrap_drupal_login() [0.25 sec, 9.04 MB] [bootstrap]
Task starts processing [0.26 sec, 9.45 MB] [queue]
Running: ssh -o PasswordAuthentication=no 'aegir'@'xxx.xx.xx.xx1' ' /var/aegir/drush/drush.php [command]
--master_db='\''mysql://aegir_root:Password@aegir.mydomain.com'\'' --platform='\''893'\''
--publish_path='\''/var/aegir/www'\'' --master_url='\''http://xxx.xx.xx.xx2'\''
--drush_path='\''/var/aegir/drush/drush.php'\'' --web_ip='\''xxx.xx.xx.xx1'\'' --script_user='\''aegir'\''
--config_path='\''/var/aegir/config'\'' --backup_path='\''/var/aegir/backups'\'' --web_id='\''600'\''
--web_host='\''mercury.designindaba.com'\'' --web_group='\''www-data'\'' --restart_cmd='\''sudo
/usr/sbin/apache2ctl graceful'\'' --root='\''/var/aegir/www'\'' provision-verify --backend' [0.27 sec, 9.54
MB]
The external command could not be executed due to an application error. [0.37 sec, 9.54 MB] [error]
[error] not be executed successfully (returned: Permission denied (publickey,password).
, code: 255) [0.38 sec, 9.86 MB]
An error occurred at function : drush_hosting_hosting_task [0.38 sec, 9.86 MB] [error]

I ran the command suggested above and maybe the output is useful

DRUSH_BACKEND_OUTPUT_START>>>{"output":"","object":[],"error_status":1,"log":[{"type":"bootstrap","message":"Drush bootstrap phase : _drush_bootstrap_drush()","timestamp":1269898106.84,"memory":1096980,"error":null},{"type":"bootstrap","message":"Drush bootstrap phase : _drush_bootstrap_drupal_root()","timestamp":1269898106.88,"memory":2776120,"error":null},{"type":"notice","message":"Initialized Drupal 6.16 root directory at \/var\/aegir\/www","timestamp":1269898106.89,"memory":3430320,"error":null},{"type":"bootstrap","message":"Drush bootstrap phase : _drush_bootstrap_drupal_site()","timestamp":1269898106.9,"memory":3484596,"error":null},{"type":"notice","message":"Initialized Drupal site default at sites\/default","timestamp":1269898106.9,"memory":3484644,"error":null},{"type":"bootstrap","message":"Drush bootstrap phase : _drush_bootstrap_drupal_configuration()","timestamp":1269898106.91,"memory":3489640,"error":null},{"type":"notice","message":"Undefined index: scheme environment.inc:688","timestamp":1269898106.91,"memory":3491676,"error":null},{"type":"notice","message":"Undefined index: user environment.inc:689","timestamp":1269898106.91,"memory":3491676,"error":null},{"type":"notice","message":"Undefined index: host environment.inc:690","timestamp":1269898106.91,"memory":3491732,"error":null},{"type":"bootstrap","message":"PDO support available, but the driver has not been installed. Assuming success.","timestamp":1269898106.92,"memory":3495552,"error":null},{"type":"bootstrap","message":"Drush bootstrap phase : _drush_bootstrap_drupal_database()","timestamp":1269898106.92,"memory":3495552,"error":null},{"type":"bootstrap","message":"Successfully connected to the Drupal database.","timestamp":1269898106.92,"memory":3495552,"error":null},{"type":"error","message":"Drush command could not be completed.","timestamp":1269898106.92,"memory":3736064,"error":"DRUSH_NOT_COMPLETED"}],"error_log":{"DRUSH_NOT_COMPLETED":["Drush command could not be completed."]},"context":{"root":"\/var\/aegir\/www","backend":true,"debug":true}}<<<DRUSH_BACKEND_OUTPUT_END

Any ideas would be appreciated, been banging my head against this for a few hours already

Thanks

maybe it's related to http://drupal.org/node/516544#comment-1810402

hth

Does look like similar behaviour to that link you posted only I am using Drush 3.0 HEAD and the latest Aegir.
The other issues look like they happen on the same server whereas my one only happens when using a remote server.

Any further ideas what could be causing this?

Thanks for the feedback briwood. I tried some stuff and here is the result.

I reinstalled DRUSH (latest head as of 3/31) and PROVISION (provision-0.4-alpha6) again and am now getting a new set of errors (progress, maybe)

I issued the following commands on the remote web/MySQL server

cd /var/aegir
mv drush drush.bak
wget http://ftp.drupal.org/files/projects/drush-All-Versions-HEAD.tar.gz
gunzip -c drush-All-Versions-HEAD.tar.gz | tar -xf -
rm drush-All-Versions-HEAD.tar.gz

cd /var/aegir/.drush
mv provision ../provision.bak
wget http://files.aegirproject.org/provision-0.4-alpha6.tgz
gunzip -c provision-0.4-alpha6.tgz | tar -xf -
rm provision-0.4-alpha6.tgz

Now I'm getting the following error in the Aegir Front End when trying to Verify the platform on the remote server:

So I ran the debug version of the command from the command-line on the local Aegir server

Things I noticed are:
1. The DRUSH is not passing the proper MySQL user creds configured for the remote server in the Aegir frontend, it is sending 'aegir'@'localhost' instead of aegir_root@localhost'
2. It is not passing directories configured for the remote server in the Aegir frontend,
sending "backup_path":"\/var\/aegir\/platforms\/backups" vs "/var/aegir/backups" configured.
"config_path":"\/var\/aegir\/platforms\/config", vs "/var/aegir/platforms/config" configured

It looks like DRUSH/PROVISION is not reading the data correctly for the remote server, it looks like it is passing some hosed up combination of the local server (where aegir is installed) and the the remote server.

Going to see what Google says about "Could not connect to the master database server (Lost connection to MySQL server at 'reading initial communication packet', system error: 111)."

Does anyone actually have remote servers working?

Giving up for now, got over a week invested and 6 new client sites stacked up. Going to just double the size of my webserver (on RackSpace Cloud Server so can do in-place upgrade). That's life on the bleeding edge.

Subscribing.