https://www.icyphoenix.com/viewtopic.php?f=35&t=7342&p=50003#p50003
-----------------------------------
spydie
Sun 29 Aug, 2010 12:04

Massive Spider Attack
-----------------------------------
Hi

Got a small problem with one of my users pages.

Results that he´s having massive spider attacks from rumanien sites, but all using an american spider,

called 80.legs

turns out to use up to 80 conections or more at the time, driving the server cpu use, nearly into red area.

 [img]http://www.icyphoenix.com/files/images/6197/spider.png[/img] 

the funny thing is, it uses ip´s from rumania etc 

but we can´t off course block IP by IP, by the time you finnish with your list, he´s back with new IP´s. And look´s like theres no way to block them by spider id ( tried it, but it´s still there).


Any idea how to get rid of this ???

Edit:

Searching 80.legs website, i found [url=http://www.80legs.com/spider.html]This

Any idea how to include this spider into the robot block list??

By htaccess or by robot text


