# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /babykamer/ Disallow: /backup/ Disallow: /cgi-bin/ Disallow: /flags/ Disallow: /htmlarea/ Disallow: /htmlarea.old/ Disallow: /images/ Disallow: /kinderkleding/ Disallow: /koi/ Disallow: /rte/ Disallow: /webwinkel/