Crawlers Database

Crawlers Database is a free, web-based platform that aggregates and provides comprehensive metadata for internet crawlers, search bots, and web scraping tools. It offers developers, SEO professionals, and researchers detailed information on user-agent strings, IP addresses, and bot behavior through both a searchable interface and a RESTful API. The service enables organizations to better identify, monitor, and manage automated traffic interacting with their digital properties.

LLM mention score

Normalized 0–100 · last 8 weeks

DataForSEO API

Get LLM mention data of any company via DataForSEO API

Get access to the structured data on keyword, brand, and website mentions in LLMs, including metrics like AI search volume, impressions, and mentions count.

Get Free API Credits API Documentation

How to get LLM mention data →

// Fetch Crawlers Database mentions
POST v3/ai_optimization/llm_mentions/search/live
[
    {
        "target": [
            {
                "keyword": "Crawlers Database",
                "search_scope": ["any"]
            }
        ],
        "platform": "chat_gpt",
        "order_by" : ["ai_search_volume,desc"]
    }
]