CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition

CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition | Signal Canvas | ScienceToStartup

Page Freshness

Signal Canvas proof surface

Canonical route: /signal-canvas/clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition

stale

Proof freshness: stale
Proof status: unverified
Display score: 7/10
Last proof check: 2026-03-31
Score updated: 2026-04-02
Score fresh until: 2026-05-02
References: 75
Source count: 3
Coverage: 50%

This page is showing the last landed evidence receipt and score bundle because the latest proof data is outside the freshness window.

Agent Handoff

Canonical ID clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition | Route /signal-canvas/clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition

REST example

curl https://sciencetostartup.com/api/v1/agent-handoff/signal-canvas/clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition

MCP example

{
  "tool": "search_signal_canvas",
  "arguments": {
    "mode": "paper",
    "paper_ref": "clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition",
    "query_text": "Summarize CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition"
  }
}

source_context

{
  "surface": "signal_canvas",
  "mode": "paper",
  "query": "CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition",
  "normalized_query": "2603.27999",
  "route": "/signal-canvas/clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition",
  "paper_ref": "clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition",
  "topic_slug": null,
  "benchmark_ref": null,
  "dataset_ref": null
}

Evidence Receipt

Route status: building

Claims: 7

References: 75

Proof: Verification pending

Freshness state: computing

Source paper: CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition

PDF: https://arxiv.org/pdf/2603.27999v1

Source count: 3

Coverage: 50%

Last proof check: 2026-03-31T20:21:07.368Z

Signal Canvas receipt window

Watch and verify: CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition

/buildability/clip-autt-test-time-personalization-with-action-unit-prompting-for-fine-grained-video-emotion-recognition

Watchwatch

Subject: CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition

Verdict

Watch

Verdict is Watch because viability or proof quality is intermediate and should be re-evaluated before execution.

Preparing verified analysis

GitHub Code Pulse

No public code linked for this paper yet.

Claim map

Strong 7Mixed 0Weak 0

Evidencepartial
We introduce CLIP-AU, a lightweight AU-guided temporal learning method that integrates interpretable AU semantics into CLIP. It learns generic, subject-agnostic representations by aligning AU prompts with facial dynamics, enabling fine-grained ER without CLIP fine-tuning or LLM-generated text supervision.
Implicationpartial
Directly and explicitly stated in both the abstract and parsed sections as the core method contribution.
Verificationpartial
partial
Evidencepartial
we propose CLIP-AUTT, a video-based test-time personalization method that dynamically adapts AU prompts to videos from unseen subjects. By combining entropy-guided temporal window selection with prompt tuning, CLIP-AUTT enables subject-specific adaptation while preserving temporal consistency.
Implicationpartial
Directly and explicitly stated in the abstract and parsed sections as the core extension of CLIP-AU.
Verificationpartial
partial
Evidencepartial
Our extensive experiments on three challenging video-based subtle ER datasets, BioVid, StressID, and BAH, indicate that CLIP-AU and CLIP-AUTT outperform state-of-the-art CLIP-based FER and TTA methods, achieving robust and personalized subtle ER.
Implicationpartial
Explicitly stated in the abstract and parsed sections as the main experimental result, though specific numeric metrics are not provided in the given excerpts.
Verificationpartial
partial
Evidencepartial
AUs encode the subtle muscle activations underlying expressions, providing localized and interpretable semantic cues for more robust ER.
Implicationpartial
Directly stated in the abstract and introduction as the foundational technical rationale for the method.
Verificationpartial
partial
Evidencepartial
CLIP-based methods either depend on CLIP's contrastive pretraining or on LLMs to generate descriptive text prompts, which are noisy, computationally expensive, and fail to capture fine-grained expressions, leading to degraded performance.
Implicationpartial
Directly stated in the abstract as a limitation of prior work, forming the motivation for the proposed method.
Verificationpartial
partial
Evidencepartial
Although CLIP-AU models fine-grained AU semantics, it does not adapt to subject-specific variability in subtle expressions. To address this limitation, we propose CLIP-AUTT...
Implicationpartial
Explicitly stated as a limitation of CLIP-AU and the direct motivation for developing CLIP-AUTT.
Verificationpartial
partial
Evidencepartial
CLIP-AUTT enables subject-specific adaptation while preserving temporal consistency.
Implicationpartial
Directly stated as a key property of the CLIP-AUTT method in the abstract and parsed sections.
Verificationpartial
partial

Author intelligence and commercialization panels stay hidden until the proof receipt is verified, cites at least 3 references, includes at least 2 sources, and clears 50% coverage. The paper narrative and citation surfaces remain public while verification is pending.

CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition

Use Signal Canvas as the narrative proof surface

Use this Signal Canvas via API or MCP

Signal Canvas proof surface