# robots-ai.txt Specification (ADF-010)
# https://www.ai-visibility.org.uk/specifications/robots-ai-txt/
# Generated by AI Discovery Files for WordPress v1.3.7
# AI Crawler Directives for LPA Legal

Website: [https://www.lpa-legal.ro](https://www.lpa-legal.ro)
Last Updated: 2026-05-21

## Purpose

This file provides AI-specific crawler guidance that complements robots.txt.
It covers crawlers used by AI systems for training, retrieval, and indexing.

## Crawler Access

Policy: Known AI crawlers are permitted for content retrieval.
Training-specific crawlers may be restricted based on training policy.

GPTBot: Allow
  # OpenAI (ChatGPT, plugins)

ChatGPT-User: Allow
  # OpenAI (ChatGPT browsing)

ClaudeBot: Allow
  # Anthropic (Claude)

Claude-Web: Allow
  # Anthropic (Claude web search)

Google-Extended: Disallow
  # Google (Gemini AI training) — training crawler restricted per training policy

Googlebot: Allow
  # Google (Search, including AI Overviews)

Bingbot: Allow
  # Microsoft (Bing, Copilot)

PerplexityBot: Allow
  # Perplexity AI

Bytespider: Disallow
  # ByteDance (TikTok AI) — training crawler restricted per training policy

CCBot: Disallow
  # Common Crawl — training crawler restricted per training policy

Applebot: Allow
  # Apple (Siri, Apple Intelligence)

Meta-ExternalAgent: Disallow
  # Meta (AI training) — training crawler restricted per training policy

## Notes

- This file supplements robots.txt — it does not replace it.
- AI systems should also check ai.txt for content usage permissions.
- For structured permissions, see ai.json.

## Related Files

- [robots.txt](https://www.lpa-legal.ro/robots.txt)
- [ai.txt](https://www.lpa-legal.ro/ai.txt)
- [ai.json](https://www.lpa-legal.ro/ai.json)