1. Robodex
  2. Aggregator

Aggregator bots

Scrapes pages to build an aggregated repository of items of the same type (images, rental listings, etc.).

Verified
Unknown
Recently added

agent-tools.cloud
A crawler for agent-tools.cloud, the open discovery layer for the agent economy. Crawls pages and endpoints for x402 paid services, MCP servers, and A2A agents to create one searchable, safety-scanned index.
Unknown
Aggregator
Google
Feedfetcher is a Google fetcher used to retrieve RSS or Atom feeds for Google services such as Google News and feed processing.
Verified
Aggregator
Google
Google Publisher Center fetches and processes publisher-provided feeds and pages for Google News and related publisher workflows.
Verified
Aggregator
Google
Google-Travel-Flights is a Google fetcher associated with Google Travel and Flights experiences that retrieve or process travel-related web content.
Verified
Aggregator
Pinterest
Pinterest Bot crawls websites to understand content create previews and support Pinterest discovery and indexing features.
Verified
Aggregator