# Robots.txt Sitemap: http://www.trulyscrumptiousbeauty.co.uk/sitemap.xml # Allow all robots to spider the domain User-agent: * Disallow: # Disallow directory /_assets/server/ User-agent: * Disallow: /_assets/server/ Disallow: /tsmen/index.asp Disallow: /websiteinformation/ Disallow: /links/ Disallow: /offers/thismonthsoffer.asp