# BatchRouter developer documentation - public and fully indexable. # # Content Signals (https://contentsignals.org): we explicitly permit # search - building a search index / returning results # ai-input - using content for AI answers (RAG / grounding / citations) # ai-train - training or fine-tuning AI models # on all public pages, matching the batchrouter.com (hub) convention. # # NOTE: if Cloudflare "managed robots.txt" is ON for this zone, Cloudflare # prepends its own block, which can override these signals for named AI bots. # Full-open requires that managed setting to be OFF. User-agent: * Content-Signal: search=yes,ai-input=yes,ai-train=yes Allow: / # LLM / agent guidance index: https://batchrouter.com/llms.txt # Hub master index (all public sitemaps): https://batchrouter.com/sitemap-index.xml Sitemap: https://docs.batchrouter.com/sitemap-index.xml Sitemap: https://batchrouter.com/sitemap-index.xml