The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection | Signal Canvas | ScienceToStartup

Page Freshness

Signal Canvas proof surface

Canonical route: /signal-canvas/the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection

ready

Proof freshness: fresh
Proof status: unverified
Display score: 3/10
Last proof check: 2026-06-03
Score updated: 2026-06-03
Score fresh until: 2026-07-03
References: 0
Source count: 3
Coverage: 50%

Page-specific freshness sourced from this paper's evidence receipt and score bundle.

Agent Handoff

Canonical ID the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection | Route /signal-canvas/the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection

REST example

curl https://sciencetostartup.com/api/v1/agent-handoff/signal-canvas/the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection

MCP example

{
  "tool": "search_signal_canvas",
  "arguments": {
    "mode": "paper",
    "paper_ref": "the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection",
    "query_text": "Summarize The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection"
  }
}

source_context

{
  "surface": "signal_canvas",
  "mode": "paper",
  "query": "The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection",
  "normalized_query": "2606.03305",
  "route": "/signal-canvas/the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection",
  "paper_ref": "the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection",
  "topic_slug": null,
  "benchmark_ref": null,
  "dataset_ref": null
}

Evidence Receipt

Route status: building

Claims: 1

References: Pending verification

Proof: Verification pending

Freshness state: computing

Source paper: The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

PDF: https://arxiv.org/pdf/2606.03305v1

Source count: 3

Coverage: 50%

Last proof check: 2026-06-03T20:48:39.914Z

Signal Canvas receipt window

Not build-ready: The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

/buildability/the-reliability-gap-in-benchmark-auditing-distribution-shift-and-scale-as-failure-modes-of-contamination-detection

Ignoreblocked

Subject: The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

Verdict

Ignore

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

Use Signal Canvas as the narrative proof surface

Use this Signal Canvas via API or MCP

Signal Canvas proof surface