Index: openacs-4/www/robots.txt =================================================================== RCS file: /usr/local/cvsroot/openacs-4/www/robots.txt,v diff -u --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ openacs-4/www/robots.txt 23 Sep 2003 22:04:22 -0000 1.1 @@ -0,0 +1,5 @@ +UserAgent: * +Disallow: /doc/ +Disallow: /api-doc/ +Disallow: /register/ +Disallow: /comments/