Robodex
GitHub stars28.2KDocsSubmit your botStart building
  1. Robodex
  2. Other

Other bots

Bots with a job that doesn't fit the main taxonomy.

Other
Verified

APIs-Google
Google
APIs-Google is a Google fetcher used by Google APIs and services to retrieve resources or perform automated service-related requests.
Verified
Other
BingPreview
Microsoft
BingPreview is Microsoft's crawler for generating snapshots of web pages for Bing. It renders pages to create visual previews and has desktop and mobile variants.
Verified
Other
BingVideoPreview
Microsoft
BingVideoPreview is Microsoft's crawler for generating video previews in Bing. It accesses video content for preview purposes and has desktop and mobile variants.
Verified
Other
Chrome Web Store
Google
Chrome Web Store fetcher traffic is associated with Google services that retrieve and process Chrome Web Store-related content.
Verified
Other
Cincraw
Cincraw
Cincraw is a web crawler that collects page content, metadata, and HTTP response information. It also retrieves JavaScript and CSS resources to render pages and save screenshots.
Verified
Other
FacebookExternalHit
Meta
FacebookExternalHit is Meta's crawler for generating previews of links shared on Facebook, Instagram, and Messenger. It retrieves and caches page titles, descriptions, and thumbnail images.
Verified
Other
Google Messages
Google
Google Messages fetcher traffic retrieves web content used by Google Messages features such as link previews and related message experiences.
Verified
Other
Google Pinpoint
Google
Google Pinpoint fetcher traffic is associated with Google's Pinpoint journalism and document analysis product retrieving web content.
Verified
Other
Google Read Aloud
Google
Google Read Aloud fetches web pages at user request so Google products can read page content aloud with text-to-speech.
Verified
Other
GoogleOther
Google
GoogleOther is a generic Google crawler used by product teams for public web crawling that is not tied to a specific named crawler.
Verified
Other
GoogleOther-Image
Google
GoogleOther-Image is a Google crawler variant used for image-related fetching outside the primary Googlebot Image workflow.
Verified
Other
GoogleOther-Video
Google
GoogleOther-Video is a Google crawler variant used for video-related fetching outside the primary Googlebot Video workflow.
Verified
Other
MicrosoftPreview
Microsoft
MicrosoftPreview fetches pages to generate previews and enrich links for Microsoft products such as Bing and productivity services.
Verified
Other