Situational Awareness Dataset

situational-awareness-dataset.org

The Situational Awareness Dataset (SAD) is a research benchmark designed to quantify and evaluate the self-knowledge and contextual understanding of Large Language Models. It assesses capabilities such as recognizing generated text, predicting model behavior, and distinguishing between internal evaluation and real-world deployment across 16 distinct tasks. This tool supports AI safety research by measuring how well models understand their own nature and operational circumstances.

LLM mention score The LLM mention score is the total number of mentions of this brand in different LLM chatbots, normalized to the scale from 0 to 100. You can get actual, non-normalized numbers via the LLM Mention API from DataForSEO.

Normalized 0–100 · last 8 weeks

DataForSEO API

Get LLM mention data of any company via DataForSEO API

Get access to the structured data on keyword, brand, and website mentions in LLMs, including metrics like AI search volume, impressions, and mentions count. 

How to get LLM mention data →
// Fetch Situational Awareness Dataset mentions
POST v3/ai_optimization/llm_mentions/search/live
[
    {
        "target": [
            {
                "keyword": "Situational Awareness Dataset",
                "search_scope": ["any"]
            }
        ],
        "platform": "chat_gpt",
        "order_by" : ["ai_search_volume,desc"]
    }
]