Meta-WebIndexer
VerifiedWhat is Meta-WebIndexer?
The Meta-WebIndexer crawler navigates the web to improve Meta AI search result quality for users. In doing so, Meta analyzes online content to enhance the relevance and accuracy of Meta AI. Allowing Meta-WebIndexer in your robots.txt file helps us cite and link to your content in Meta AI’s responses.
How to detect Meta-WebIndexer with Fingerprint
This requires you to have Fingerprint installed in your codebase. If not it will assist you to get setup quickly.
Add invisible bot detection to your site today
Set up in minutes by package manager or CDN. No credit card or sales call required.