this could be helpful I believe,<br><br><a href="http://drupal.org/node/53579">http://drupal.org/node/53579</a><span style="font-style: italic; text-decoration: underline;"><span style="text-decoration: underline;"><span style="font-style: italic;">
<br><br></span></span>Use this module when you are running multiple Drupal sites from a
single code base (multisite) and you need a different robots.txt file
for each one. This module generates the robots.txt file dynamically and
gives you the chance to edit it, on a per-site basis, from the web UI.</span><br><br><div><span class="gmail_quote">On 6/12/06, <b class="gmail_sendername">dondi_2006</b> <<a href="mailto:dondi_2006@libero.it">dondi_2006@libero.it
</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Greetings,<br><br>I'm setting up several independent websites:<br><br>
<a href="http://www.myfamilywebsite.net">www.myfamilywebsite.net</a><br><a href="http://www.myhobbieswebsite.org">www.myhobbieswebsite.org</a><br>etc etc<br><br>all off one drupal installation, placing settings,<br>modules, themes etc.... in the proper sites/ subfolders.
<br><br>Fact is, I want some of those domains indexed by search<br>engines, and other (for example <a href="http://myfamilywebsite.net">myfamilywebsite.net</a>) to<br>be NOT indexed.<br><br>How/what do I set up to make sure that
<a href="http://myfamilywebsite.net">myfamilywebsite.net</a> sends a robots.txt files DISALLOWING robot spidering,<br>while the other domain serve a *different* (indexing friendly) robot.txt?<br><br>I understand that this is at least partly an http server
<br>thing, but (apart from knowing how it should be done at<br>that level): is such a requirement compatible with one<br>drupal installation? Or I will have to install and maintain one drupal for each domain?<br><br>TIA,<br>
O.<br><br>--<br>[ Drupal support list | <a href="http://lists.drupal.org/">http://lists.drupal.org/</a> ]<br></blockquote></div><br>