- Robodex
- AI assistant
AI assistant bots
Uses LLMs and on-demand page visits to answer questions; fetches URLs when prompted but cannot change information.
Signed
Verified
Recently added
Amazon
Amzn-User represents Amazon user-triggered fetching behavior for Amazon services that access web content on behalf of users.
VerifiedAI assistant
OpenAI
ChatGPT-User represents OpenAI user-triggered browsing or fetching when ChatGPT accesses web content in response to a user request.
VerifiedAI assistant
Anthropic
Claude-User represents Anthropic user-initiated fetching when Claude accesses web content in response to a user request.
VerifiedAI assistant
DuckDuckGo
DuckAssistBot is a DuckDuckGo bot associated with AI-assisted answer features that fetch or process web content for user-facing responses.
VerifiedAI assistant
Google
Gemini Deep Research is a Google Gemini capability that researches topics across web sources and compiles structured reports for users.
VerifiedAI assistant
Google
Google NotebookLM fetcher traffic is associated with Google's NotebookLM product retrieving web content provided or requested by users.
VerifiedAI assistant
Hark
Hark Agent fetches pages a signed-in Hark user has explicitly asked it to visit — research, form-filling, and account actions on services the user already has access to. Each request is initiated by a real user session.
Hark Agent is not a search crawler. It does not index the web, build datasets, or train models on fetched content.
SignedAI assistant
Kimi
Kimi-User is the web retrieval bot for Moonshot AI’s assistant, Kimi. When you ask Kimi to summarize a link or search the live web, Kimi-User visits the relevant web pages in real time to collect the details you need.
VerifiedAI assistant
Meta
The Meta-ExternalFetcher crawler fetches individual links at a user’s request and supports product functions such as evaluating and improving agentic AI capabilities—including helping AI navigate websites to complete tasks for users. Accordingly, this crawler may bypass robots.txt rules.
VerifiedAI assistant
Mistral
MistralAI-User is the web retrieval bot for Mistral AI’s assistant. When you ask Mistral to summarize a link or search the live web, MistralAI-User visits the relevant web pages in real time to collect the details you need.
VerifiedAI assistant
Perplexity
Perplexity-User represents Perplexity user-triggered fetching when Perplexity accesses web content in response to a user request.
VerifiedAI assistant