Robodex
GitHub stars28.2KDocsSubmit your botStart building
  1. Robodex
  2. AI crawler
  3. CCBot

CCBot

Verified

What is CCBot?

CCBot is Common Crawl's crawler used to collect public web crawl data for open datasets used in research and search applications.

How to detect CCBot with Fingerprint

Fingerprint identifies CCBot through the bot detection Smart Signal. If you already have Fingerprint installed, add a detection rule for it. If not, view our Quick Start Guide to get up and running in minutes.

Add invisible bot detection to your site today

Set up in minutes by package manager or CDN. No credit card or sales call required.

Start for free Talk to an expert