# Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for everyone # Disallow: if this matches first part of requested path, # forget it User-agent: * # applies to all robots Disallow: /asp-bin/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /database/ Disallow: /gb/foot.asp Disallow: /gb/hoeklinks.asp Disallow: /nl/foot.asp Disallow: /nl/hoeklinks.asp Disallow: /pics/bg/ Disallow: /pics/hoek/