Bots - Granular access controls for the top Personal Agents

The Configure AI bot policies setting is now named AI Crawler and Agent access policies.

Personal agents act on a person's behalf, fetching information or browsing in response to a request. The updated policies let you set actions for the top Personal Agents individually. This gives you control over agent access while allowing visitors to use agents to find answers or compare products using your site's content.

Customize how Personal Agents access your site via Security > Settings > AI Crawler and Agent access policies.

Personal Agents inherit your existing Agents policy by default. Cloudflare recommends Allow (do not block) for Personal Agents.

For more information, check out our blog ↗︎ or refer to our documentation for AI Crawler and Agent access policies.