November 18, 2026 · AzureIn preview
Public Preview: AI bot ruleset for Azure Front Door Premium WAF
Announcing the public preview of the AI bot ruleset for Azure Web Application Firewall (WAF) on Azure Front Door Premium.
AI crawlers and agents visit your site for different reasons, and you may want to allow some but not others. Robots.txt only works when a bot chooses to follow it, and some bots pretend to be a well-known AI crawler. The AI bot ruleset identifies AI bots, groups them by purpose, and enforces your choice for each group at the edge.
With this preview, you can choose an action for each of four categories:
- AI training, for verified crawlers that collect public content to train or fine-tune AI models.
- AI search, for verified crawlers that index content to power AI search, answers, and summaries.
- AI interactive agents, for verified agents that fetch pages in real time when a person asks an AI assistant.
- Miscellaneous AI agents, for AI bots that can't be verified, including bots that falsely claim to be a well-known AI crawler.
Microsoft keeps the AI bot signatures up to date, with no ruleset version change needed. Every rule starts with the Log action, so you can review your AI bot traffic in WAF logs and WAF insights before anything is blocked. You can set each category to Allow, Block, Log, JS challenge, or CAPTCHA, and configure the ruleset in the Azure portal, Azure PowerShell, Azure CLI, or Bicep.
Free. Unsubscribe any time.
Related updates
Public Preview: Microsoft HTTP DDoS Ruleset for Azure WAF on Azure Front Door Premium
Public Preview: Azure WAF CAPTCHA Challenge for Azure Front Door
Generally Available: HTTP DDoS ruleset for Azure Front Door Premium WAF
Bots - New options to manage AI traffic · Cloudflare
AWS WAF announces AI activity dashboard for visibility into AI bot and agent traffic · AWS