# Block aggressive SEO scrapers User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / # Default policy for all other crawlers (including major AI/LLM crawlers that # obey robots.txt: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-Web, # Google-Extended, Applebot-Extended, PerplexityBot, etc.). # # Denylist model: everything is crawlable EXCEPT the private/ephemeral routes # listed below. New public pages are indexable by default. (The old allowlist # silently blocked /rules, /app and /help because nobody added an Allow line.) User-agent: * Allow: / # Live game rooms: infinite, ephemeral share-code URLs with nothing to index. Disallow: /game/ # Authenticated / utility pages — no public content, must stay out of search. Disallow: /settings Disallow: /verify-email Disallow: /forgot-password # NOTE: some utility pages stay crawlable on purpose — they carry their own # `noindex` meta, which Google can only honor if it is allowed to fetch the # page. Don't add Disallow lines for noindex'd routes. # Ad-verification crawlers — Playwire onboarding requires both agents below to # be explicitly allowlisted (exact format from their docs) so they can fetch # ads.txt and verify the site. Note: a named group replaces the `*` group for # that agent, so these two also bypass the Disallow lines above — harmless. User-Agent: Verity/1.1 (https://gumgum.com/verity; verity-support@gumgum.com) Allow: / User-agent: AmazonAdBot Allow: / Sitemap: https://barricade.gg/sitemap.xml