Better Robots.txt
better-robots.comBetter Robots.txt is a WordPress plugin designed to simplify crawl governance and AI visibility for enterprise websites. It enables teams to manage robots.txt policies, control access for AI crawlers like GPTBot and ClaudeBot, and publish machine-readable llms.txt files through a guided interface without manual code editing. The solution helps organizations reduce crawl waste, enforce usage policies, and maintain compliance with modern search engine and AI agent requirements.
LLM mention score The LLM mention score is the total number of mentions of this brand in different LLM chatbots, normalized to the scale from 0 to 100. You can get actual, non-normalized numbers via the LLM Mention API from DataForSEO.
Normalized 0–100 · last 8 weeks
DataForSEO API
Get LLM mention data of any company via DataForSEO API
Get access to the structured data on keyword, brand, and website mentions in LLMs, including metrics like AI search volume, impressions, and mentions count.
How to get LLM mention data →// Fetch Better Robots.txt mentions POST v3/ai_optimization/llm_mentions/search_mentions/live [ { "target": [ { "domain": "better-robots.com", "search_filter": "include", "search_scope": ["sources"] } ], "order_by": ["ai_search_volume,desc"] } ]
