SEO, Multisite, Robots - Help Needed

kpastore's picture

I am working on a site (http://www.car-rental-salt-lake-city.com/) and am having issues with getting the Google robots to search and index it. This is a multisite installation on Drupal 6 with the RobotsTxt module (http://drupal.org/project/robotstxt) installed. The robots text file is located here: http://www.car-rental-salt-lake-city.com/robots.txt. It has been submitted using the Google Webmaster Tools, but still has not been indexed after 4 weeks.

Anyone with experience have any ideas as to what may be going on?

Thanks!

Groups:
Login to post comments

First, you really should set

elvis2's picture
elvis2 - Wed, 2009-08-05 09:08

First, you really should set your "www." option in your .htaccess file. Then, go to Google's webmaster tools, and check your robots.txt file. There might be a character somewhere causing an issue with Google.

You mention multisite, what is the link to it? If you have the same content on a subdomain vs main domain, Google will penalize you and be forced to index one and not the other.

===
Elvis McNeely (formerly known as mcneelycorp)
Blogging about Drupal and web development: http://www.elvisblogs.org/drupal


The other site on the

kpastore's picture
kpastore - Wed, 2009-08-05 13:43

The other site on the multisite setup is a different URL altogether. It is not a subdomain (http://www.valueautorental.com/). I'll check on the .htaccess file. I agree, it should be set to one or the other. But, since the original site (valueautorental.com) is indexing just fine without this modification, I'm not sure this is the problem.


Both links have different

elvis2's picture
elvis2 - Wed, 2009-08-05 15:43

Both links have different content, so no worries with multisite and same content. Is not your case. I would check Google Webmaster tools to see if there are any hints in the reports why googlebot is not visiting your pages.

===
Elvis McNeely (formerly known as mcneelycorp)
Blogging about Drupal and web development: http://www.elvisblogs.org/drupal