Agents
Undocumented AI Agents
Every known artificial agent (bot) on the internet. You can track their activity on your website with Agent Analytics, or control their behavior with Automatic Robots.txt.
Undocumented AI Agents
anthropic-ai
anthropic-ai is a unconfirmed agent possibly used by Anthropic to download training data for its LLMs (Large Language Models) that power AI products like Claude.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
ApifyBot
ApifyBot is an undocumented AI agent operated by Apify. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
Claude-Web
Claude-Web is an AI-related agent operated by Anthropic. It's currently unclear exactly what it's used for, since there's no official documentation.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
cohere-ai
cohere-ai is an unconfirmed agent possibly dispatched by Cohere's AI chat products in response to user prompts when it needs to retrieve content on the internet.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
Crawl4AI
Crawl4AI is an undocumented AI agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
DeepSeekBot
DeepSeekBot is an undocumented AI agent operated by DeepSeek. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
iAskBot
iAskBot is an undocumented AI agent operated by iAsk. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
iaskspider
iaskspider is an undocumented AI agent operated by Ai Search. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
KunatoCrawler
KunatoCrawler is an undocumented AI agent operated by Zzazz. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
TavilyBot
TavilyBot is an undocumented AI agent operated by Tavily. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
TerraCotta
TerraCotta is an undocumented AI agent. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →
WRTNBot
WRTNBot is an undocumented AI agent operated by Wrtn. If you think this is incorrect or can provide additional detail about its purpose, please let us know.
Undocumented AI Agent
AI-powered bot with an unclear purpose, often used for undisclosed data collection
See More →