User-agent: * Disallow: /header.html/ Disallow: /menu.html/ Disallow: /*.html/ Disallow: /.html/ Disallow: /main.php?directed=yes/