Getting Control of Spiders...
Support folk, I'm getting Page not Found errors in my Drupal log every hour, on multiple sites on my server, for the files I deleted from the root directory: - install.php - CHANGELOG.txt - INSTALL.txt - INSTALL.mysql.txt - INSTALL.pgsql.txt - LICENSE.txt - MAINTAINERS.txt - UPGRADE.txt - COPYRIGHT.txt The robots.txt tells the bots to ignore those pages... but??? Should I just ignore it? Any good wisdom someone has on advising on how to handle all those bots that are pinging my server all the time? Thanks, Shai
.htaccess. robots.txt is optional, and not all bots respect it, or even check for it. I'd also wager that it's not bots but scripts trying to find many of those files and execute exploits. install.php? Where would a search engine bot find a link to that, or CHANGELOG.txt? Alternatively, you could just put all the file back in place ;) -Mike __________________ Michael Prasuhn 503.512.0822 office mike@mikeyp.net http://mikeyp.net On Jun 18, 2010, at 2:53 PM, Shai Gluskin wrote:
Support folk,
I'm getting Page not Found errors in my Drupal log every hour, on multiple sites on my server, for the files I deleted from the root directory:
• install.php • CHANGELOG.txt • INSTALL.txt • INSTALL.mysql.txt • INSTALL.pgsql.txt • LICENSE.txt • MAINTAINERS.txt • UPGRADE.txt • COPYRIGHT.txt
The robots.txt tells the bots to ignore those pages... but???
Should I just ignore it? Any good wisdom someone has on advising on how to handle all those bots that are pinging my server all the time?
Thanks,
Shai -- [ Drupal support list | http://lists.drupal.org/ ]
Hi all, I put website "under maintenance" so nobody can see while I'm developing. Though,m I would like to show my "client" what have I done without making the site live. Is it possible to "extend" permission that e.g. "owner" role can also see the website while off? Thanks, Afan
Check the permission "administer site configuration" for role owner. I would recommend though to use .htaccess to make sure the site is not seen while developing. Google for ".htaccess protect directory". Then you don't have to put the site offline in Drupal. It's just a few lines of code but has the advantage that you can also see how your site will look for anonymous users when finished. Hans 2010/6/19 Afan Pasalic <afan@afan.net>
Hi all, I put website "under maintenance" so nobody can see while I'm developing. Though,m I would like to show my "client" what have I done without making the site live. Is it possible to "extend" permission that e.g. "owner" role can also see the website while off?
Thanks, Afan
-- [ Drupal support list | http://lists.drupal.org/ ]
-- Hans Rossel KOBA Webdesign bvba Beukenlaan 56 9051 Gent (Sint-Denijs-Westrem) Belgium BTW 0817.931.516 +32.9.334.52.60 +32.472.79.32.16 www.koba.be info@koba.be
KOBA | Hans Rossel wrote:
Check the permission "administer site configuration" for role owner. exactly what I need. :-)
thanks
I would recommend though to use .htaccess to make sure the site is not seen while developing. Google for ".htaccess protect directory". Then you don't have to put the site offline in Drupal. It's just a few lines of code but has the advantage that you can also see how your site will look for anonymous users when finished.
Hans
2010/6/19 Afan Pasalic <afan@afan.net <mailto:afan@afan.net>>
Hi all, I put website "under maintenance" so nobody can see while I'm developing. Though,m I would like to show my "client" what have I done without making the site live. Is it possible to "extend" permission that e.g. "owner" role can also see the website while off?
Thanks, Afan
-- [ Drupal support list | http://lists.drupal.org/ ]
-- Hans Rossel KOBA Webdesign bvba Beukenlaan 56 9051 Gent (Sint-Denijs-Westrem) Belgium BTW 0817.931.516 +32.9.334.52.60 +32.472.79.32.16 www.koba.be <http://www.koba.be> info@koba.be <mailto:info@koba.be>
Anyone with the 'administer site configuration' can still view the site, they just get the "Operating in off-line mode" message, so you could just put them in a role with that permission and have them login. Jamie Holly http://www.intoxination.net http://www.hollyit.net On 6/19/2010 10:55 AM, Afan Pasalic wrote:
Hi all, I put website "under maintenance" so nobody can see while I'm developing. Though,m I would like to show my "client" what have I done without making the site live. Is it possible to "extend" permission that e.g. "owner" role can also see the website while off?
Thanks, Afan
That's what aI was looking for. Thanks guys. Jamie Holly wrote:
Anyone with the 'administer site configuration' can still view the site, they just get the "Operating in off-line mode" message, so you could just put them in a role with that permission and have them login.
Jamie Holly http://www.intoxination.net http://www.hollyit.net
On 6/19/2010 10:55 AM, Afan Pasalic wrote:
Hi all, I put website "under maintenance" so nobody can see while I'm developing. Though,m I would like to show my "client" what have I done without making the site live. Is it possible to "extend" permission that e.g. "owner" role can also see the website while off?
Thanks, Afan
participants (5)
-
Afan Pasalic -
Jamie Holly -
KOBA | Hans Rossel -
Michael Prasuhn -
Shai Gluskin