User-agent: * Disallow: /owner/ Disallow: /admin/ Disallow: /api/ Disallow: /process_ Disallow: /report Disallow: /claim Allow: / # SEO-tool and bulk-data crawlers that copy sites but send no customers User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: serpstatbot User-agent: Barkrowler Disallow: / Sitemap: https://bizpage.org/sitemap.xml