# Robots.txt file for http://www.9web.co.uk User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /includes/ Disallow: /assets/ Disallow: /js/ Disallow: /Mail/ Disallow: /internals/ Disallow: /blogin/ Disallow: /bloginq_/ Disallow: /datepick/ Disallow: /css/ Disallow: /fm/ Disallow: /Net/ Disallow: /plugins/ Disallow: /Smarty/ Disallow: /templates_c/ Disallow: /greybox/ Disallow: /abt/ Disallow: /everyman/ Sitemap: http://www.9web.co.uk/sitemap.xml