Cloudflare

Cloudflare-AutoRAG is Cloudflare's web crawler that indexes websites for AI Search (formerly AutoRAG), a managed retrieval-augmented generation service. The crawler automatically ingests and continuously indexes website content to enable natural language search and AI-powered applications without requiring manual reprocessing.

Cloudflare Browser Rendering is a serverless browser automation service that runs on Cloudflare Workers. It enables AI agents and applications to control a headless browser directly from the edge, allowing them to navigate websites, interact with dynamic content, and extract data at scale without managing browser infrastructure.

AgentReadinessScanner is a bot operated by Cloudflare that scans websites to assess their readiness for AI agents by checking for emerging standards such as llms.txt, MCP, agent skills, markdown negotiation, and various API and commerce protocols. The bot provides website owners with a report on their site's compatibility with AI agent technologies across categories including discoverability, content accessibility, bot access control, protocol discovery, and commerce.

bushbaby is a bot operated by Cloudflare, a company that provides web infrastructure and security services. This bot is likely used for monitoring, testing, or maintaining Cloudflare's network and services.

Cloudflare Radar URL Scanner is a developer helper operated by Cloudflare. If you think this is incorrect or can provide additional detail about its purpose, please let us know.

Cloudflare SpeedTest is a bot operated by Cloudflare that performs speed tests to measure website performance and connectivity. It may visit websites to test network latency, bandwidth, and overall loading times as part of Cloudflare's performance monitoring services.

Collapsify is a Cloudflare internal service that crawls customer error pages to serve them directly from Cloudflare's edge network. This improves performance by caching and delivering error pages from edge locations rather than origin servers.

Cloudflare-Validator is a security scanner operated by Cloudflare that validates and verifies web properties as part of their content delivery network and security services. This bot performs automated security checks and validation tasks for websites using Cloudflare's infrastructure.

DigiCert DCV (Domain Control Validation) is a security scanner bot operated by Cloudflare that validates domain ownership for SSL/TLS certificate issuance. It verifies that certificate applicants have control over the domains they want to secure.

CloudFlare-Prefetch is a bot operated by Cloudflare that prefetches web content to improve page load times and performance for websites using Cloudflare's content delivery network and optimization services. This bot crawls and caches web pages in advance so they can be served more quickly to end users.