# Robots.txt file created by John Simpson(Rare IT) # For domain: http://www.rareitsolutions.co.uk # All robots will spider the domain User-agent: * Disallow: /asm-email-footers/ Disallow: /cgi-bin/ Disallow: /dm-april07-emailer/ Disallow: /lyndale/ Disallow: /stage/ Disallow: /storage_concepts/ Disallow: /Templates/ Sitemap: http://www.rareit.co.uk/sitemap.xml