# robots.txt User-agent: * Disallow: /test/ Disallow: /index Allow: index.htm