----- Original Message -----
From: David Graham <>
Sent: Friday, August 08, 2003 10:42 AM
> I have the following 2 lines in my robots.txt to prevent search engines
> indexing the files and folders off the sefriendly folder:
> User-agent: *
> Disallow: /sefriendly/
> To prevent access to another folder off the root folder called www2, do I
> just add another disallow line like below
> Disallow: /www2/
Prevent and disallow or even allow or not adequate descriptions of
what robots.txt does.
Although those terms are frequently used.
Robots.txt are "suggestions" for compliant bots.
Htaccess is a control which implements prevention, allows and disallows.