# SE Crawlers Setup ## Enable robots.txt rules for all crawlers User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /search Sitemap: https://www.cbdeaze.co.uk/sitemap_index.xml # Paths (no clean URLs) Disallow: /*?*