Robots.txt

[Fred]

I've actually got a website that I don't want Mr. Google or his mates to
crawl. Can anyone point me to the correct text I type to block all. I know I
can add <meta name="robots" content="noindex,nofollow"> to every page but
I'm not sure of the wording for the actual robots text. Fred

 

[Dan L]

http://www.searchengineworld.com/robots/robots_tutorial.htm

 

[Dan L]

Better yet, go here!

http://www.google.com/robots.txt

 

[Cheryl D Wise]

You can use this online robots.txt file generator:
http://www.webtoolcentral.com/webmaster/tools/robots_txt_file_generator/

--
Cheryl D. Wise
MS FrontPage MVP
http://mvp.wiserways.com
http://starttoweb.com
Online instructor led web design training - Next Session June 26th