# Peopletree Group crawl policy - generated by scripts/seo/emit.ts # Public pages are available to search, research and AI crawlers. # Private, authenticated and API paths remain excluded below. # Explicit AI and AI-assisted search crawler permissions User-agent: OAI-SearchBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /customer-hub Disallow: /home-concept Disallow: /internal/ Disallow: /proposals/ User-agent: ClaudeBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /customer-hub Disallow: /home-concept Disallow: /internal/ Disallow: /proposals/ User-agent: PerplexityBot Allow: / Disallow: /admin Disallow: /api/ Disallow: /customer-hub Disallow: /home-concept Disallow: /internal/ Disallow: /proposals/ User-agent: Google-Extended Allow: / Disallow: /admin Disallow: /api/ Disallow: /customer-hub Disallow: /home-concept Disallow: /internal/ Disallow: /proposals/ # Model-training crawlers User-agent: GPTBot Disallow: / User-agent: * Allow: / # Private / gated areas Disallow: /admin Disallow: /api/ Disallow: /customer-hub Disallow: /home-concept Disallow: /internal/ Disallow: /proposals/ # Machine-readable indexes for LLM ingestion # https://peopletreegroup.com/llms.txt - link index, every page also available as .md # https://peopletreegroup.com/llms-full.txt - full text of every page # Sitemap Sitemap: https://peopletreegroup.com/sitemap.xml