- Robodex
- Aggregator
Aggregator bots
Scrapes pages to build an aggregated repository of items of the same type (images, rental listings, etc.).
Verified
Unknown
Recently added
agent-tools.cloud
A crawler for agent-tools.cloud, the open discovery layer for the agent economy. Crawls pages and endpoints for x402 paid services, MCP servers, and A2A agents to create one searchable, safety-scanned index.
UnknownAggregator
Google
Feedfetcher is a Google fetcher used to retrieve RSS or Atom feeds for Google services such as Google News and feed processing.
VerifiedAggregator
Google
Google Publisher Center fetches and processes publisher-provided feeds and pages for Google News and related publisher workflows.
VerifiedAggregator
Google
Google-Travel-Flights is a Google fetcher associated with Google Travel and Flights experiences that retrieve or process travel-related web content.
VerifiedAggregator
Pinterest
Pinterest Bot crawls websites to understand content create previews and support Pinterest discovery and indexing features.
VerifiedAggregator