Google-Safety
What is Google-Safety?
About
Google-Safety is a specialized security crawler that performs abuse-specific scanning to detect malware and other security threats on publicly posted links across Google properties, operating independently of robots.txt restrictions. You can see how often Google-Safety visits your website by setting up Dark Visitors Agent Analytics.
Agent Type
Expected Behavior
Security scanners probe websites for vulnerabilities, malware, configuration issues, and other threats. Scan frequency varies widely. Some services run continuous monitoring with daily or hourly checks, while others perform one-time or periodic assessments. Scans may target specific endpoints or comprehensively test multiple pages and functionalities depending on what exactly is being scanned and the site's risk profile.
Detail
| Operated By | |
| Last Updated | 1 hour ago |
Insights
Top Website Robots.txts
Country of Origin
Global Traffic
The percentage of all internet traffic coming from Security Scanners
Top Visited Website Categories
Robots.txt
Should I Block Google-Safety?
Probably not. Security scanners can be beneficial, especially if they're configured to report issues back to you.
How Do I Block Google-Safety?
You can block Google-Safety or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.
| User Agent String | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.113 Safari/537.36 (compatible; Google-Safety; +http://www.google.com/bot.html) |
# In your robots.txt ...
User-agent: Google-Safety # https://darkvisitors.com/agents/google-safety
Disallow: /
⚠️ Manual Robots.txt Editing Is Not Scalable
New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.