User-agent: * Disallow: /pages/ Disallow: /default.asp Disallow: /navigation.html Disallow: /home.html