This is a discussion on Re: mod_spambot, reports from the trenches? within the Apache Web Server forums, part of the Web Server and Related Forums category; On Mon, 25 Apr 2005 14:00:13 +0000, Ignoramus8409 wrote: > I would like to make sure that rogue ...
|
|||||||
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
|
|||
|
On Mon, 25 Apr 2005 14:00:13 +0000, Ignoramus8409 wrote:
> I would like to make sure that rogue bots that pound my sites with > incessant requests, are blocked, while at the same time, important and > well behaved bots such as googlebot are never blocked from accessing > my site. > > Once in a while I get hit with bots such as teleport pro and > "WebDownload", which I already have blocked, but I do not want to be > hit by some other bot. > > I heard of mod_spambot and am concerned that it may block legitimate > crawlers. Legitimate crawlers, such as Google, can be whitelisted. > Any thoughts on actually using mod_spambot? |