Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots explores A benchmark and failure analysis for LLM-driven smartphone automation, identifying critical issues in UI accessibility and LLM design.. Commercial viability score: 7/10 in Mobile Agents.
Use This Via API or MCP
This route is the stable paper-level surface for citations, viability, references, and downstream handoffs. Use it as the proof layer behind Signal Canvas, workspace creation, and launch-pack generation.
Page Freshness
Canonical route: /paper/do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs
This page is showing the last landed evidence receipt and score bundle because the latest proof data is outside the freshness window.
Agent Handoff
Canonical ID do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs | Route /paper/do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs
REST example
curl https://sciencetostartup.com/api/v1/agent-handoff/paper/do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vsMCP example
{
"tool": "get_paper",
"arguments": {
"arxiv_id": "2604.17817"
}
}source_context
{
"surface": "paper",
"mode": "paper",
"query": "Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots",
"normalized_query": "2604.17817",
"route": "/paper/do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs",
"paper_ref": "do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs",
"topic_slug": null,
"benchmark_ref": null,
"dataset_ref": null
}Paper proof page receipt window
/buildability/do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs
Subject: Do LLMs Need to See Everything? A Benchmark and Study of Failures in LLM-driven Smartphone Automation using Screentext vs. Screenshots
Verdict
Watch
Verdict is Watch because viability or proof quality is intermediate and should be re-evaluated before execution.
Time to first demo
Insufficient data
No first-demo timestamp, owner estimate, or elapsed demo receipt is attached to this surface.
Structured compute envelope
Insufficient data
No data, compute, hardware, memory, latency, dependency, or serving requirement receipt is attached.
Constellation, claims, and market context stay visible on the paper proof page even when commercialization rails are held back for incomplete proof receipts.
Research neighborhood
Interactive graph renders after load.
Preparing verified analysis
Dimensions overall score 7.0
Visual citation anchors from the paper document graph.
Owned Distribution
Get the weekly shortlist of commercializable papers, benchmark movers, and proof receipts that matter for product execution.
References are not available from the internal index yet.
Receipt path
/buildability/do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs
Paper ref
do-llms-need-to-see-everything-a-benchmark-and-study-of-failures-in-llm-driven-smartphone-automation-using-screentext-vs
arXiv id
2604.17817
Generated at
2026-04-21T02:39:59.163Z
Evidence freshness
stale
Last verification
2026-04-21T02:39:59.163Z
Sources
3
References
0
Coverage
50%
Lineage hash
36efb30cf00a82e004ddf818f2a439f4a2573ff85349aff181132486014fa943
Canonical opportunity-kernel lineage hash.
External signature
unsigned_external
No founder, registry, pilot, or production-adoption signature is attached to this receipt.
Verification
not_verified
Verification is blocked until an external signature is provided.
Pending verification refs / 3 sources / Verification pending
repo_url
references
This equation captures one of the core mathematical components of the system. > </button> < > < > <p > </p> <p > </p> <p > </p> <button > </button> < > </ > </ > = = = = = Explore Tour Eiffel - Parc
Page and bbox are available; crop image is pending.
This equation captures one of the core mathematical components of the system. <button > <p > </p> </button> = = = Search here
Page and bbox are available; crop image is pending.
This equation captures one of the core mathematical components of the system. <button > <p > </p> </button> = = = GO = GO
Page and bbox are available; crop image is pending.
No public competitor map is available for this paper yet.