Get Rif Of Spider Bots


Subject: Get Rif Of Spider Bots
Hello...

I've got a page in a subfolder outside from IP root and i'd like to keep it private...

How can i drop the bots even googlebot to avoid spider?

I want this page never to be visible in google search!!!




Thankssssss

Subject: Re: Get Rif Of Spider Bots
borbo wrote: [View Post]
Hello...

I've got a page in a subfolder outside from IP root and i'd like to keep it private...

How can i drop the bots even googlebot to avoid spider?

I want this page never to be visible in google search!!!




Thankssssss



This is not an Icy related question... anyway, take a look to this ;)


http://www.robotstxt.org/wc/exclusion-admin.html

Subject: Re: Get Rif Of Spider Bots
I'm verry sorry for the offtopic...It was 06:34 in greece so you ca understand how destroyed i was ! :shock:

Subject: Re: Get Rif Of Spider Bots
mmm...nowan icy phoeinix question....

My IP is in a folder ex. /httpdoacs/phpBB2/

Do i have to move robots.txt one folder up and edit it changing the paths?

Subject: Re: Get Rif Of Spider Bots
borbo wrote: [View Post]
mmm...nowan icy phoeinix question....

My IP is in a folder ex. /httpdoacs/phpBB2/

Do i have to move robots.txt one folder up and edit it changing the paths?




It is explained in that page ;)


I suggest you to put robots.txt in the root and specify in it which folder allow or not to the bot spidering.


Page 1 of 1


  
You cannot post new topics
You cannot reply to topics
You cannot edit your posts
You cannot delete your posts
You cannot vote in polls
You cannot attach files
You can download files
You cannot post calendar events

   

This is a "Lo-Fi" version of our main content. To view the full version with more information, formatting and images, please click here.

Powered by Icy Phoenix based on phpBB
Generation Time: 0.0963s (PHP: 17% SQL: 83%)
SQL queries: 10 - Debug Off - GZIP Enabled