What is kagi-fetcher?
kagi-fetcher is an AI Assistant operated by Kagi that fetches web content to answer user queries through Kagi AI, their suite of AI-powered tools including Assistant, Research, and other knowledge discovery features. Agent Analytics can track when it visits your website.
Overview
| Operated By | Kagi |
| Expected To Follow Robots.txt | Yes |
| Insights Last Updated | July 10, 2026 |
Category
Expected Behavior
kagi-fetcher fetches one page at a time, the moment someone asks a question it can answer, so it never crawls your site. How much you see depends on how many people use kagi-fetcher and how often they ask about what your site covers. A popular assistant can hit you steadily, while a single user or a niche one stays quiet between occasional spikes.
kagi-fetcher's User Agent
| User Agent | kagi-fetcher/1.0 |
How To Block kagi-fetcher With Robots.txt
Add this rule to your robots.txt file to block kagi-fetcher from accessing your entire website, or use Automatic Robots.txt to block all AI assistants at once. You can customize which pages are blocked by swapping out / for a different path.
User-agent: kagi-fetcher # https://knownagents.com/agents/kagi-fetcher
Disallow: /kagi-fetcher Global Insights
As of July 10, 2026, this data reflects agent visits measured across thousands of websites using Agent Analytics, combined with daily scans of the world's top 1000 websites and their robots.txt files.
Robots.txt Blocked Percentage
Country of Origin
Robots.txt Blocking Trend
0% of top websites block kagi-fetcher in their robots.txt files.
Overall AI Assistant Traffic
1.2% of all web traffic came from AI assistants.
Top Visited Website Categories
The types of websites most frequently visited by kagi-fetcher.
Frequently Asked Questions
Should I Block kagi-fetcher?
Probably not. kagi-fetcher fetches a page when someone asks a question it can answer, and the response cites and links to your site. Blocking it removes you from those answers without improving your Google rankings, because assistants play no part in traditional search indexing. Almost none of the top websites we track have robots.txt rules for kagi-fetcher right now.
Does kagi-fetcher Respect Robots.txt?
Yes. kagi-fetcher is expected to honor robots.txt rules, so a disallow rule is the right first move. Automatic Robots.txt adds and maintains that rule for you, and Agent Analytics confirms kagi-fetcher actually honors it.
Does kagi-fetcher Access Private Content?
It has no way in. kagi-fetcher fetches pages the way an anonymous visitor loads a URL, with no stored logins. Anything behind a paywall or a login stays out of its reach.
Why Is kagi-fetcher Visiting My Website?
Someone asked Kagi's assistant a question your page can help answer. kagi-fetcher retrieved the page in that moment to ground the answer, usually with a citation linking back to you.
How Can I Tell if kagi-fetcher Is Visiting My Website?
Agent Analytics tracks kagi-fetcher visits in real time alongside every other known AI agent, crawler, and scraper. You can also check your server logs for requests whose user agent string contains "kagi-fetcher". Look for fetches of individual pages that do not follow a crawl pattern. Keep in mind that kagi-fetcher doesn't publish a verification method, so any client can claim its user agent string and a log match is a hint rather than proof.