Robot.txt?

[Arthur Pratz]

Hi, Does anyone know about robot.txt?
Do I really need one for my site?
If so, how do I get it and what does it do for me?
Thanks for your time,
Mike Pratz
http://www.chowardcompany.com

 

[Tom J]

Hi, Does anyone know about robot.txt?
Do I really need one for my site?
If so, how do I get it and what does it do for me?
Thanks for your time,
Mike Pratz
http://www.chowardcompany.com

That's all covered under "Secrets" on the site I already gave you.

Tom J

 

[news]

robots.txt is used to prevent spiders and bots (well behaved ones) from
accessing files or directories. You don't need it unless you want to
prevent pages or directories from being indexed by search engines, etc...
Follow the link below.

http://www.robotstxt.org/wc/robots.html