Hello...
I've got a page in a subfolder outside from IP root and i'd like to keep it private...
How can i drop the bots even googlebot to avoid spider?
I want this page never to be visible in google search!!!
Thankssssss
Icy Phoenix
Old Support Topics - Get Rif Of Spider Bots
borbo [ Sun 10 Jun, 2007 05:34 ]
Post subject: Get Rif Of Spider Bots
Post subject: Get Rif Of Spider Bots
Vortex [ Sun 10 Jun, 2007 10:27 ]
Post subject: Re: Get Rif Of Spider Bots
This is not an Icy related question... anyway, take a look to this
http://www.robotstxt.org/wc/exclusion-admin.html
Post subject: Re: Get Rif Of Spider Bots
borbo wrote: [View Post]
This is not an Icy related question... anyway, take a look to this
http://www.robotstxt.org/wc/exclusion-admin.html
borbo [ Sun 10 Jun, 2007 16:09 ]
Post subject: Re: Get Rif Of Spider Bots
Post subject: Re: Get Rif Of Spider Bots
I'm verry sorry for the offtopic...It was 06:34 in greece so you ca understand how destroyed i was ! 
borbo [ Sun 10 Jun, 2007 16:20 ]
Post subject: Re: Get Rif Of Spider Bots
Post subject: Re: Get Rif Of Spider Bots
mmm...nowan icy phoeinix question....
My IP is in a folder ex. /httpdoacs/phpBB2/
Do i have to move robots.txt one folder up and edit it changing the paths?
My IP is in a folder ex. /httpdoacs/phpBB2/
Do i have to move robots.txt one folder up and edit it changing the paths?
Vortex [ Sun 10 Jun, 2007 19:51 ]
Post subject: Re: Get Rif Of Spider Bots
It is explained in that page
I suggest you to put robots.txt in the root and specify in it which folder allow or not to the bot spidering.
Post subject: Re: Get Rif Of Spider Bots
borbo wrote: [View Post]
It is explained in that page
I suggest you to put robots.txt in the root and specify in it which folder allow or not to the bot spidering.