Bot directory

A continuously updated directory of bots Fingerprint can detect. Test your own bots here and submit (opens in a new tab) them to be included in this list.

Signed

Verified

Unknown

Recently added

AdIdxBot

Microsoft

AdIdxBot is a Microsoft advertising crawler used to access ad-related landing pages and content for Microsoft advertising products.

Verified

Advertising

AdsBot

Google

AdsBot is a Google crawler used to check ad landing pages and related content for Google Ads quality policy and rendering workflows.

Verified

Advertising

AdsBot Mobile Web

Google

AdsBot Mobile Web is Google's mobile ads crawler used to evaluate mobile landing pages and ad-related web content.

Verified

Advertising

AdSense

Google

The AdSense crawler visits participating sites to analyze page content and help Google serve relevant ads.

Verified

Advertising

AdsPower FlowerBrowser

AdsPower

AdsPower FlowerBrowser is an anti-detect browser profile used with AdsPower for browser automation account management and RPA workflows.

Unknown

Browser automation

AdsPower SunBrowser

AdsPower

AdsPower SunBrowser is an AdsPower anti-detect browser used for profile isolation browser automation and multi-account workflows.

Unknown

Browser automation

AGI Agent

AGI Inc

AGI Agent is an AI browser agent from AGI Inc. associated with evaluating and running agents in real-world web environments.

Signed

AI agent

AhrefsBot

Ahrefs

AhrefsBot is Ahrefs' web crawler used to collect web data for SEO analysis backlink indexes and search marketing tools.

Verified

SEO

AhrefsSiteAudit

Ahrefs

AhrefsSiteAudit is an Ahrefs crawler used for site audit checks and SEO analysis of website health and technical issues.

Verified

SEO

Amazon Q Web Crawler

Amazon

Amazon Q Web Crawler fetches and indexes web content for Amazon Q Business applications.

Unknown

AI crawler

Amazonbot

Amazon

Amazonbot is Amazon's crawler used to improve Alexa shopping search and other Amazon services by accessing public web content.

Verified

AI crawler

AmazonProductDiscoverybot

Amazon

AmazonProductDiscoverybot is an Amazon crawler used to discover product information and merchant pages for Amazon product discovery workflows.

Unknown

eCommerce

Amzn-SearchBot

Amazon

Amzn-SearchBot is an Amazon search crawler used to discover and index public web content for Amazon search-related services.

Verified

Search crawler

Amzn-User

Amazon

Amzn-User represents Amazon user-triggered fetching behavior for Amazon services that access web content on behalf of users.

Verified

AI assistant

Anchor Browser

Anchor

Anchor Browser provides cloud browser infrastructure for AI agents and supports Web Bot Auth for verifiable agent identity.

Signed

AI browser

Apify Website Content Crawler

Apify

Apify Website Content Crawler extracts text metadata and page content from websites for crawling scraping and AI data workflows.

Signed

Scraping

APIs-Google

Google

APIs-Google is a Google fetcher used by Google APIs and services to retrieve resources or perform automated service-related requests.

Verified

Other

Applebot

Apple

Applebot is Apple's web crawler used by Siri Spotlight Safari Apple Intelligence and other Apple services to index and retrieve web content.

Verified

Search crawler

Baiduspider

Baidu

Baiduspider is Baidu's search crawler used to discover and index web pages for Baidu Search and related search services.

Verified

Search crawler

Bedrock AgentCore

AWS

Bedrock AgentCore Browser Tool lets AWS Bedrock agents use a managed browser to interact with websites and web applications.

Signed

AI agent

BeEF

beefproject/beef

BeEF is the Browser Exploitation Framework a penetration testing tool focused on browser-based security assessment and exploitation.

Unknown

Browser automation

Bingbot

Microsoft

Bingbot is Microsoft's search crawler used to discover crawl and index pages for Bing Search and related Microsoft search experiences.

Verified

Search crawler

BingPreview

Microsoft

BingPreview is Microsoft's crawler for generating snapshots of web pages for Bing. It renders pages to create visual previews and has desktop and mobile variants.

Verified

Other

BingVideoPreview

Microsoft

BingVideoPreview is Microsoft's crawler for generating video previews in Bing. It accesses video content for preview purposes and has desktop and mobile variants.

Verified

Other

BrowserAutomationStudio

bablosoft/BAS

BrowserAutomationStudio is a visual browser automation tool for building bots parsers uploaders and workflows that automate Chrome-based browsing.

Unknown

Browser automation

Browserbase Agent

Browserbase

Browserbase Agent represents Browserbase browser infrastructure for AI agents providing verified identity sessions proxies and web access.

Signed

AI agent

Bytespider

ByteDance

Bytespider is ByteDance's web crawler used to access and index public web content for ByteDance search and content products.

Verified

Search crawler

CartAI Agentic Commerce as a Service

CartAI

CartAI Agentic Commerce as a Service is an AI agent commerce service that helps agents interact with shopping and checkout workflows.

Verified

AI agent

CCBot

Common Crawl

CCBot is Common Crawl's crawler used to collect public web crawl data for open datasets used in research and search applications.

Verified

AI crawler

ChatGPT Agent

OpenAI

ChatGPT Agent is OpenAI's agentic browsing product that can use web pages and perform multi-step tasks for users.

Signed

AI agent

ChatGPT Agent Dots

OpenAI

Dots are capable, always-on agents built to handle everything. Powered by GPT‑6 Astra, they have their own cloud computer, learn from feedback over time, and can work towards your goals 24/7.

Signed

AI agent

ChatGPT-User

OpenAI

ChatGPT-User represents OpenAI user-triggered browsing or fetching when ChatGPT accesses web content in response to a user request.

Verified

AI assistant

Chrome Web Store

Google

Chrome Web Store fetcher traffic is associated with Google services that retrieve and process Chrome Web Store-related content.

Verified

Other

ChromeHeadless

chromium/chromium

ChromeHeadless is Chrome's headless mode allowing Chromium to run without a visible UI for automation testing rendering and scraping.

Unknown

Browser automation

Cincraw

Cincraw is a web crawler that collects page content, metadata, and HTTP response information. It also retrieves JavaScript and CSS resources to render pages and save screenshots.

Verified

Other

Claude Code (Agent SDK)

Anthropic

Claude Code (Agent SDK) is Anthropic's AI coding agent that helps developers write, review, and ship code. It can run as a GitHub action, a service integration or as a custom app.

Unknown

AI agent

Claude Code (CLI)

Anthropic

Claude Code (CLI) is Anthropic's AI coding agent that helps developers write, review, and ship code. It runs as a terminal CLI, IDE extension, and cloud agent, and can call external tools through MCP servers

Unknown

AI agent

Claude Code (Desktop)

Anthropic

Claude Code (Desktop) is Anthropic's AI coding agent that helps developers write, review, and ship code. It runs as a desktop app, and can call external tools through MCP servers

Unknown

AI agent

Claude-SearchBot

Anthropic

Claude-SearchBot is Anthropic's search crawler used to retrieve web content for Claude search-related experiences.

Verified

AI search

Claude-User

Anthropic

Claude-User represents Anthropic user-initiated fetching when Claude accesses web content in response to a user request.

Verified

AI assistant

ClaudeBot

Anthropic

ClaudeBot is Anthropic's crawler used to access public web content for Claude and related AI systems according to Anthropic's crawler policy.

Verified

AI crawler

Cloudflare Browser Rendering

Cloudflare

Cloudflare Browser Rendering runs programmable headless browsers on Cloudflare's network for automation rendering screenshots scraping and AI agents.

Signed

Browser automation

Cloudflare Radar URL Scanner

Cloudflare

Cloudflare Radar URL Scanner scans URLs to analyze security network performance and technology details for threat and web intelligence.

Signed

Monitoring

CocCocBot

Coccoc

CocCocBot is the web crawler for Cốc Cốc, a Vietnamese search engine and browser. It discovers and indexes web pages for inclusion in Cốc Cốc search results.

Verified

Search crawler

Codex

OpenAI

Codex is OpenAI's AI coding agent that helps developers write, review, and ship code. It runs as a terminal CLI, IDE extension, and cloud agent, and can call external tools through MCP servers.

Unknown

AI agent

Cursor

Anysphere

Cursor is Anysphere's AI code editor with an agent that helps developers complete coding tasks. Its Model Context Protocol (MCP) support lets the agent connect to external tools and data sources.

Unknown

AI agent

CybaaAgent

Cybaa

CybaaAgent is a Cybaa security-related bot or agent that identifies itself with Web Bot Auth for trusted verifiable requests.

Signed

Security

CybaaBot

Cybaa

CybaaBot is a Cybaa security-related bot that uses verified identity signals to make its automated traffic distinguishable.

Verified

Security

Datadog Synthetics

Datadog

Datadog Synthetics bots run scripted API and browser tests to monitor website and application availability behavior and performance.

Verified

Monitoring

DuckAssistBot

DuckDuckGo

DuckAssistBot is a DuckDuckGo bot associated with AI-assisted answer features that fetch or process web content for user-facing responses.

Verified

AI assistant

DuckDuckBot

DuckDuckGo

DuckDuckBot is DuckDuckGo's search crawler used to improve DuckDuckGo search results and web indexing.

Verified

Search crawler

Exabot

Dassault Systemes

Exabot is the web crawler associated with Exalead, a search technology company owned by Dassault Systèmes. It fetches web pages to build search indexes.

Verified

Search crawler

FacebookExternalHit

Meta

FacebookExternalHit is Meta's crawler for generating previews of links shared on Facebook, Instagram, and Messenger. It retrieves and caches page titles, descriptions, and thumbnail images.

Verified

Other

Feedfetcher

Google

Feedfetcher is a Google fetcher used to retrieve RSS or Atom feeds for Google services such as Google News and feed processing.

Verified

Aggregator

Fingerprint Agent

Fingerprint

Fingerprint Agent is Fingerprint's Web Bot Auth test or agent identity implementation for validating signed bot traffic.

Verified

AI agent

FingerprintBot

Fingerprint

Fingerprint bot helps analyze the configuration and security of websites protected by Fingerprint products

Unknown

Browser automation

Geb

apache/groovy-geb

Geb is a Groovy browser automation framework built on WebDriver for scripting scraping and functional or acceptance testing.

Unknown

Browser automation

Gemini Deep Research

Google

Gemini Deep Research is a Google Gemini capability that researches topics across web sources and compiles structured reports for users.

Verified

AI assistant

Ghost Inspector

Ghost Inspector is a cloud-based browser testing service that runs recorded interactions on websites and web applications. It checks functionality and alerts teams when tests fail or screenshots change.

Verified

Monitoring

Google Messages

Google

Google Messages fetcher traffic retrieves web content used by Google Messages features such as link previews and related message experiences.

Verified

Other

Google NotebookLM

Google

Google NotebookLM fetcher traffic is associated with Google's NotebookLM product retrieving web content provided or requested by users.

Verified

AI assistant

Google Pinpoint

Google

Google Pinpoint fetcher traffic is associated with Google's Pinpoint journalism and document analysis product retrieving web content.

Verified

Other

Google Publisher Center

Google

Google Publisher Center fetches and processes publisher-provided feeds and pages for Google News and related publisher workflows.

Verified

Aggregator

Google Read Aloud

Google

Google Read Aloud fetches web pages at user request so Google products can read page content aloud with text-to-speech.

Verified

Other

Google Site Verifier

Google

Google Site Verifier fetches verification tokens and related pages to confirm site ownership for Google Search Console and other services.

Verified

SEO

Google StoreBot

Google

Google StoreBot crawls product and store pages to support Google shopping commerce and product discovery experiences.

Verified

eCommerce

Google-CloudVertexBot

Google

Google-CloudVertexBot is associated with Google Cloud Vertex AI fetching or processing web content for AI workflows.

Verified

AI crawler

Google-InspectionTool

Google

Google-InspectionTool fetches pages for Google Search inspection tools helping site owners test indexing and rendering behavior.

Verified

Monitoring

Google-Safety

Google

Google-Safety handles abuse and security-related fetching such as checking publicly posted links for malware or policy risks.

Verified

Security

Google-Travel-Flights

Google

Google-Travel-Flights is a Google fetcher associated with Google Travel and Flights experiences that retrieve or process travel-related web content.

Verified

Aggregator

Googlebot

Google

Googlebot is Google's primary search crawler used to discover crawl render and index pages for Google Search.

Verified

Search crawler

Googlebot Image

Google

Googlebot Image crawls and indexes images and image-related resources for Google Images and Google Search features.

Verified

Search crawler

Googlebot Video

Google

Googlebot Video crawls and indexes video pages and video-related resources for Google Search and video search experiences.

Verified

Search crawler

GoogleOther

Google

GoogleOther is a generic Google crawler used by product teams for public web crawling that is not tied to a specific named crawler.

Verified

Other

GoogleOther-Image

Google

GoogleOther-Image is a Google crawler variant used for image-related fetching outside the primary Googlebot Image workflow.

Verified

Other

GoogleOther-Video

Google

GoogleOther-Video is a Google crawler variant used for video-related fetching outside the primary Googlebot Video workflow.

Verified

Other

GPTBot

OpenAI

GPTBot is OpenAI's web crawler used to access public web content that may improve OpenAI models and AI products.

Verified

AI crawler

Grok Bot

x.ai

Grok Bot is your team of always-on agents. They have their own computer and work inside tools and apps like you do.

Signed

AI agent

HarkBot

Hark

Hark Agent fetches pages a signed-in Hark user has explicitly asked it to visit — research, form-filling, and account actions on services the user already has access to. Each request is initiated by a real user session. Hark Agent is not a search crawler. It does not index the web, build datasets, or train models on fetched content.

Signed

AI assistant

Headless Browser

unknown

Headless Browser refers to browser execution without a visible UI commonly used for automated testing rendering scraping and monitoring.

Unknown

Browser automation

HenryAgent

Henry

HenryAgent is a Henry Labs agent associated with agentic commerce and embedded checkout workflows for AI-assisted transactions.

Signed

AI agent

iPhone Simulator

apple/xcode

iPhone Simulator is Apple's Xcode simulator environment for running and testing iOS apps without a physical device.

Unknown

Browser automation

Kimi-User

Kimi

Kimi-User is the web retrieval bot for Moonshot AI’s assistant, Kimi. When you ask Kimi to summarize a link or search the live web, Kimi-User visits the relevant web pages in real time to collect the details you need.

Verified

AI assistant

KlaviyoAIBot

Klaviyo

KlaviyoAIBot is Klaviyo's web crawler designed to fetch and index publicly available content from domains you have connected to your account. This process enhances AI experiences on your website and within Klaviyo by generating tailored content and recommendations. You can control its crawling behavior through robots.txt and other settings, ensuring it respects your site's rules and only accesses desired content.

Signed

AI crawler

Lovable

Lovable is an AI-powered software engineer and full-stack web application builder. Instead of requiring you to write code, set up backend servers, or configure deployment pipelines manually, Lovable turns natural language descriptions, wireframe sketches, or screenshots directly into live, functional web software.

Unknown

AI agent

MailRUBot

Mail.ru

MailRUBot is an automated web crawler operated by Mail.ru. It discovers and indexes web pages to support Mail.ru’s search services, helping users find website content through search results.

Verified

Search crawler

Manus Agent

Manus

Manus Agent is an AI agent from Manus designed to perform web and computer tasks on behalf of users.

Signed

AI agent

MCPBeat

mcpbeat.com

MCP server analytics bot, checking the uptime, availability and other useful metrics of the most popular MCP servers.

Verified

Monitoring

Meta-ExternalAds

Meta

Meta-ExternalAds is a Meta crawler associated with ad and external content fetching for Meta products and advertising workflows.

Verified

Advertising

Meta-ExternalAgent

Meta

Meta-ExternalAgent is Meta's web crawler for collecting content used to train foundation AI models and improve products through content indexing. Website owners can control its access through robots.txt.

Verified

AI crawler

Meta-ExternalFetcher

Meta

The Meta-ExternalFetcher crawler fetches individual links at a user’s request and supports product functions such as evaluating and improving agentic AI capabilities—including helping AI navigate websites to complete tasks for users. Accordingly, this crawler may bypass robots.txt rules.

Verified

AI assistant

Meta-WebIndexer

Meta

The Meta-WebIndexer crawler navigates the web to improve Meta AI search result quality for users. In doing so, Meta analyzes online content to enhance the relevance and accuracy of Meta AI. Allowing Meta-WebIndexer in your robots.txt file helps us cite and link to your content in Meta AI’s responses.

Verified

AI search

MicrosoftPreview

Microsoft

MicrosoftPreview fetches pages to generate previews and enrich links for Microsoft products such as Bing and productivity services.

Verified

Other

MistralAI-User

Mistral

MistralAI-User is the web retrieval bot for Mistral AI’s assistant. When you ask Mistral to summarize a link or search the live web, MistralAI-User visits the relevant web pages in real time to collect the details you need.

Verified

AI assistant

Muse

Meta

Meta Muse is an autonomous personal AI agent developed by Meta that executes multi-step, real-world tasks and manages long-term goals

Unknown

AI agent

Nekuda Payment Executor

Nekuda

Nekuda Payment Executor is an agentic payment tool that enables AI agents or delegated workflows to execute payment-related actions.

Signed

AI agent

NoDriver

ultrafunkamsterdam/nodriver

NoDriver is a Python browser automation library and successor to undetected-chromedriver designed for scraping and automation without WebDriver.

Unknown

Browser automation

Notte Browser

Notte

Notte Browser is an AI browser automation platform for web agents enabling agents to browse interact with and extract information from websites.

Signed

AI browser

OAI-AdsBot

OpenAI

OAI-AdsBot is OpenAI's crawler for reviewing web pages submitted as ads on ChatGPT. It checks landing-page safety and policy compliance and may use page content to assess ad relevance. Its data is not used to train generative AI foundation models.

Unknown

Advertising

OAI-SearchBot

OpenAI

OAI-SearchBot is OpenAI's search crawler used to surface and retrieve web content for search-related AI experiences.

Verified

AI search

Perplexity-User

Perplexity

Perplexity-User represents Perplexity user-triggered fetching when Perplexity accesses web content in response to a user request.

Verified

AI assistant

PerplexityBot

Perplexity

PerplexityBot is Perplexity's crawler used to retrieve and index web content for Perplexity's AI answer and search products.

Verified

AI crawler

PetalBot

Huawei

PetalBot is Huawei's crawler for Petal Search used to access and index web pages for search results and content recommendations.

Verified

AI crawler

Phantomas

macbre/phantomas

Phantomas is a headless-browser-based web performance metrics collector that analyzes pages and reports technical performance data.

Unknown

Browser automation

PhantomJS

ariya/phantomjs

PhantomJS is a discontinued scriptable headless WebKit browser used for page automation screenshots testing and web scraping.

Unknown

Browser automation

Pingdom

Pingdom probes monitor website and service uptime performance and availability from distributed monitoring locations.

Verified

Monitoring

Pinterest Bot

Pinterest Bot crawls websites to understand content create previews and support Pinterest discovery and indexing features.

Verified

Aggregator

Playwright

microsoft/playwright

Playwright is a browser automation framework for end-to-end testing and scripting across Chromium Firefox and WebKit.

Unknown

Browser automation

Prerender

Prerender crawls and renders JavaScript-heavy pages to provide cached HTML snapshots for search engines and social crawlers.

Verified

SEO

Quick Web Crawler

AWS

Web Crawler integration in Amazon Quick, that can create knowledge bases from website content by crawling and indexing web pages

Unknown

AI crawler

Rhino

mozilla/rhino

Rhino is Mozilla's JavaScript engine for Java used to run and embed JavaScript in Java applications and automation contexts.

Unknown

Browser automation

SeekportBot

Seekport

SeekportBot is Seekport's search crawler used to discover and index public web pages for Seekport's search services.

Verified

Search crawler

Selenium

SeleniumHQ/selenium

Selenium is a browser automation project and WebDriver implementation used for testing scripting and controlling browsers programmatically.

Unknown

Browser automation

SemrushBot

Semrush

SemrushBot is Semrush's crawler used to collect web data for SEO analytics site audits and search visibility products.

Verified

SEO

SeznamBot

Seznam

SeznamBot is the web crawler operated by Seznam, a Czech search engine. It discovers and indexes website content for inclusion in Seznam search results.

Verified

Search crawler

ShapBot

Parallel.ai

Parallel.ai operates automated web bots that crawl and retrieve web content for its AI-focused search and research platform. Its bots discover, index, and fetch publicly available webpages so AI agents can search the web, extract information, perform deep research, monitor changes, and generate up-to-date answers with source citations. Parallel’s indexing crawler, ShapBot, builds and refreshes its proprietary web index, while its retrieval systems may access pages in response to user or agent requests.

Verified

AI crawler

Sogou Spider

Sogou

Sogou Spider is the web crawler operated by Sogou, a Chinese search engine. It crawls web pages to collect and index content for Sogou search results.

Verified

Search crawler

Stripebot

Stripe

Stripebot is Stripe's crawler used to access merchant pages and related content for Stripe products and integrations.

Verified

Monitoring

Ultralight

Ultralight is an embeddable HTML rendering engine for games and native applications. It renders web content and runs JavaScript through a C++ or C API, without requiring a full browser interface.

Unknown

Browser automation

Undetected ChromeDriver

ultrafunkamsterdam/undetected-chromedriver

Undetected ChromeDriver is a patched Selenium ChromeDriver package designed to reduce detection by common anti-bot systems.

Unknown

Browser automation

Visual Studio Code

Microsoft

Visual Studio Code is Microsoft’s AI coding editor an agentic environment that helps developers write, review, and ship code. It runs as a text editor and can call external tools through MCP servers

Unknown

AI agent

WebDriver

webdriver

WebDriver is a W3C browser automation protocol for remotely controlling user agents in testing and automation workflows.

Unknown

Browser automation

WebsiteTrackerBot

WebsiteTracker

WebsiteTrackerBot is WebsiteTracker's crawler used to monitor website changes availability and page content over time.

Verified

Monitoring

Yahoo Slurp

Yahoo

This is Yahoo's web crawler for collecting and indexing website content. It supports Yahoo Search and gathers content for services such as Yahoo News, Finance, and Sports.

Verified

Search crawler

YandexBot

Yandex

YandexBot is Yandex's crawler used to access and index web pages for Yandex Search and related services.

Verified

Search crawler

Yeti

Naver

Yeti is Naver's web crawler used to discover and index pages for Naver Search and related search services.

Verified

Search crawler

YisouSpider

Alibaba

YisouSpider is Alibaba/UC's search crawler used to discover and index web pages for Shenma/Yisou mobile search services.

Unknown

Search crawler

Add invisible bot detection to your site today

Set up in minutes by package manager or CDN. No credit card or sales call required.

Start for free

Talk to an expert