# MotifLoom robots.txt # Allow search engines and AI assistants to discover public content. # Block training-only crawlers that don't provide search value. User-agent: * Allow: / Disallow: /dashboard Disallow: /settings Disallow: /saved Disallow: /feed Disallow: /api/ # AI search assistants — ALLOWED (they show our content to users) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Anthropic-ai Allow: / # AI training crawlers — BLOCKED (they scrape for model training, no user benefit) User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://motifloom.com/sitemap.xml # AI/LLM context file # See https://llmstxt.org/ # LLMs-Full: https://motifloom.com/llms.txt