Known Agents
Setup Guides
Agent & LLM Analytics
Automatic Robots.txt
Agent Database
Global Insights
Pricing
Sign In
Sign Up
Menu
Setup Guides
Agent & LLM Analytics
Automatic Robots.txt
Agent Database
Global Insights
Pricing
Sign In
Sign Up
Arquivo
Agents
Archivers
Arquivo-web-crawler
Arquivo-web-crawler is the Portuguese web archive's bot that systematically crawls and preserves Portuguese websites for historical research, creating a comprehensive digital heritage of Portugal's web presence.
Archiver
Captures and stores historical website snapshots for long-term digital preservation
See More →