Hi Everyone

I look at the who's online block on this site and see:

Search Engine Bots: Google, Google Feed-fetcher, Yahoo! Slurp, MSN

I see google bot on my site currently from time to time. How do I know which other bots are enabled and which ones you should let in to help index your website? Basically trying to get an understanding on how this all works.

I know the bot crawls the site and looks at links. How do I get the bot to index say the photo album?

How do I know which bots have attempted to crawl the site? Is there a log kept somewhere with the bots name?

------------

Also on this line in the who's online window:

Example:


Where it says 'Guests' is there a way to seperate guests from bots and have a bot stat as well?


Thanks for the help


-D1-

____________
Check out my new website:
Adult Forums - A place where everyone can fit in.
Currently running v1.1.10.25 RC3

Anyone have any feedback on these questions?

Thanks

-D1-

____________
Check out my new website:
Adult Forums - A place where everyone can fit in.
Currently running v1.1.10.25 RC3

Anyone have any answers for me on those questions and I have just one more.

I know the robots.txt file is used to tell or deny the bots where they can go. Is there a list of what bots are allowed? I see all the denied bots is there a list we can compare against too know which bots are good and bad?

Thanks

-D1-

____________
Check out my new website:
Adult Forums - A place where everyone can fit in.
Currently running v1.1.10.25 RC3