WebMagic

WebMagic is an open-source, lightweight Java crawler framework designed for flexible and scalable web data extraction. It provides a complete lifecycle management for crawling tasks, including URL scheduling, page downloading, content parsing, and result persistence. The framework features a modular architecture with chainable APIs, supporting multi-threading and distributed deployment via Redis integration.

LLM mention score

Normalized 0–100 · last 8 weeks

DataForSEO API

Get LLM mention data of any company via DataForSEO API

Get access to the structured data on keyword, brand, and website mentions in LLMs, including metrics like AI search volume, impressions, and mentions count.

Get Free API Credits API Documentation

How to get LLM mention data →

// Fetch WebMagic mentions
POST v3/ai_optimization/llm_mentions/search/live
[
    {
        "target": [
            {
                "keyword": "WebMagic",
                "search_scope": ["any"]
            }
        ],
        "platform": "chat_gpt",
        "order_by" : ["ai_search_volume,desc"]
    }
]