AI Shield Plugin

The AI Shield plugin protects your services from aggressive bots and scrapers without affecting real users. It is an advanced security layer that detects and manages non-human traffic based on their patterns and identifiers.

⚙️ Configuration

The plugin is typically enabled for entire domains but can be overridden at the route level.

- urn: "urn:crate:plugin:ai-shield"
  name: "bot-protection"
  type: "request_filter"
  active: true
  config:
    mode: "block" # Options: "strict", "block"
    allow_indexers: true

Field Definitions

Field	Type	Description
`mode`	string	The bot detection and management strategy. Can be “strict” (limit to 5 req/min) or “block” (reject with 403).
`allow_indexers`	boolean	Set to `true` to allow known search engine bots (Google, Bing) while blocking scrapers.

🚀 Examples

1. Block Scrapers Globally

config:
  mode: "block"

2. Strict Rate Limiting for Bots

config:
  mode: "strict"
  allow_indexers: true # Allows Google to index but limits its crawl rate

🏗️ How it Works

AI Shield inspects the User-Agent and traffic patterns to identify known crawler bots (e.g., GPTBot, ClaudeBot, Bytespider). This protection runs before your backend is even touched, saving your server resources (and bill) from wasted compute cycles.