User-agent: * Disallow: /app_browsers/ Disallow: /app_code/ Disallow: /app_data/ Disallow: /app_plugins/ Disallow: /app_themes/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /config/ Disallow: /css/ Disallow: /data/ Disallow: /install/ Disallow: /macrocripts/ Disallow: /masterpages/ Disallow: /scripts/ Disallow: /umbraco/ Disallow: /umbraco_client/ Disallow: /usercontrols/ Disallow: /xslt/ User-agent: AhrefsSiteAudit Allow: / User-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/87.0.4280.88 YextBot/Java Safari/537.36 Allow: / sitemap: https://azets.co.uk/sitemap.xml