[support] bots getting past password protection

[Anoop John]

Can you please share the rule that you have set up in htaccess to
password protect your site?

If you add

Disallow: /

in robots.txt then legit search engine bots will ignore your development site.

Thanks
Anoop

|--
| Zyxware Technologies
| http://www.zyxware.com
|--
| Be the change you wish to see in the world, M. K. Gandhi
|--


On Mon, Jun 10, 2013 at 12:08 AM, Don <donald at fane.com> wrote:
> Hi,
> This might be a little OT, but might be a common problem too.
> I'm using the Auth protection in .htaccess to password protect
> development sites. I'm using Apache 2.2
>
> For some reason, the pages in these site are showing up in search
> results, even though theoretically protected. Has anyone else seen this
> problem and found a way to block them?
>
> Thanks.
> -Don-
>
>
> --
> [ Drupal support list | http://lists.drupal.org/ ]