# www.robotstxt.org/ # General settings #User-agent: * #Crawl-delay: 5 # Sitemaps Sitemap: https://www.carmi.be/sitemap-nl.xml Sitemap: https://www.carmi.be/sitemap-en.xml Sitemap: https://www.carmi.be/sitemap-fr.xml Sitemap: https://www.carmi.be/sitemap-de.xml User-agent: * Allow: / # Blocked bots User-agent: DataForSeoBot Disallow: / User-agent: facebookexternalhit Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-Agent: GPTBot Disallow: / User-Agent: Amazonbot Disallow: / User-agent: MSNbot Disallow: /