What is HeadlessChrome?
Headless Chrome is a tool provided by Google's open source Chromium project that gives software the ability to render web pages in full detail. One of the most common use cases is enabling AI agents to browse the internet through libraries like Playwright and Puppeteer. Agent Analytics can track when it visits your website.
Category
Expected Behavior
HeadlessChrome is generic automation, so its pattern is whatever script or AI is driving it. Human guided runs look like short deliberate sessions, while autonomous runs look like a browser that never gets tired. Judge it by request timing and paths, which reveal more than its name does.
Overview
| Expected To Follow Robots.txt | No |
| Insights Last Updated | July 6, 2026 |
Robots.txt Blocked Percentage
Country of Origin
Robots.txt Blocking Trend
As of July 6, 2026, 0% of top websites block HeadlessChrome in their robots.txt files.
Overall Automated Agent Traffic
As of July 6, 2026, 0.1% of all web traffic came from automated agents.
Top Visited Website Categories
This data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the world's top 1000 websites and their robots.txt files.
HeadlessChrome's User Agent
| User Agent | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/133.0.6943.16 Safari/537.36 |
Access other known user agents and IP addresses using the Enterprise API.
How To Block HeadlessChrome
Add this rule to your robots.txt file to request that HeadlessChrome not access your website. You can customize which pages are blocked by swapping out / for a different path.
User-agent: HeadlessChrome # https://knownagents.com/agents/headlesschrome
Disallow: /Frequently Asked Questions
Should I Block HeadlessChrome?
Judge it by its behavior. Agents in this category range from harmless testing tools to abusive automation, and HeadlessChrome's purpose depends on whoever is running it. Block it if it hits login pages, submits forms, or crawls faster than any human could. Almost none of the top websites we track have robots.txt rules for HeadlessChrome right now.
Does HeadlessChrome Respect Robots.txt?
No. HeadlessChrome is not expected to honor robots.txt, so a disallow rule only states your preference. Enforce the block with firewall or server rules, then confirm in Agent Analytics that its requests actually stop.
Does HeadlessChrome Access Private Content?
It accesses whatever it is scripted to access. If someone gives HeadlessChrome credentials, it can do anything that account can do. Without them, it is limited to public pages.
Why Is HeadlessChrome Visiting My Website?
Someone automated a task that involves your site. HeadlessChrome could be running tests, collecting data, or following an AI system's instructions, and its visit pattern tells you more than its user agent string does.
How Can I Tell if HeadlessChrome Is Visiting My Website?
Agent Analytics tracks HeadlessChrome visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user agent string contains "HeadlessChrome". Look for regular timing and repeated paths that no human browsing would produce. Keep in mind that HeadlessChrome doesn't publish a verification method, so any client can claim its user agent string and a log match is a hint rather than proof.