# http://www.milbot.nu # All robots will spider the domain User-agent: * Disallow: # Disallow directory /cgi-bin/ User-agent: * Disallow: /cgi-bin/ # Disallow directory /bilder/ User-agent: * Disallow: /bilder/ # Disallow directory /anders30/ User-agent: * Disallow: /anders30/ # Disallow directory /old/ User-agent: * Disallow: /old/