EvalAI

eval.ai

EvalAI is an open-source web platform designed for organizing and participating in machine learning challenges to evaluate artificial intelligence algorithms at scale. It provides features such as custom evaluation protocols, remote compute capabilities, and CLI support, enabling organizations to host competitions with public and private leaderboards. The platform facilitates the comparison of state-of-the-art AI models through scalable infrastructure and Docker-based submission handling.

LLM mention score The LLM mention score is the total number of mentions of this brand in different LLM chatbots, normalized to the scale from 0 to 100. You can get actual, non-normalized numbers via the LLM Mention API from DataForSEO.

Normalized 0–100 · last 8 weeks

DataForSEO API

Get LLM mention data of any company via DataForSEO API

Get access to the structured data on keyword, brand, and website mentions in LLMs, including metrics like AI search volume, impressions, and mentions count. 

How to get LLM mention data →
// Fetch EvalAI mentions
POST v3/ai_optimization/llm_mentions/search/live
[
    {
        "target": [
            {
                "keyword": "EvalAI",
                "search_scope": ["any"]
            }
        ],
        "platform": "chat_gpt",
        "order_by" : ["ai_search_volume,desc"]
    }
]