- Robodex
- AI assistant
- Meta-ExternalFetcher
Meta-ExternalFetcher
VerifiedWhat is Meta-ExternalFetcher?
The Meta-ExternalFetcher crawler fetches individual links at a user’s request and supports product functions such as evaluating and improving agentic AI capabilities—including helping AI navigate websites to complete tasks for users. Accordingly, this crawler may bypass robots.txt rules.
How to detect Meta-ExternalFetcher with Fingerprint
This requires you to have Fingerprint installed in your codebase. If not it will assist you to get setup quickly.
Add invisible bot detection to your site today
Set up in minutes by package manager or CDN. No credit card or sales call required.