HandX: Scaling Bimanual Motion and Interaction Generation

Dimensions overall score 7.0

• HandX introduces a new motion-capture dataset of 54.2 hours (5.9M frames) targeting underrepresented bimanual interactions with detailed finger dynamics.method 95%
• HandX's annotation strategy uses a decoupled approach that extracts motion features and leverages large language models to produce fine-grained, semantically rich descriptions.method 90%
• Larger models trained on larger, higher-quality datasets produce more semantically coherent bimanual motion, showing a clear scaling trend.result 85%
• HandX's dataset provides significantly more fine-grained text annotations (485.7K) compared to existing datasets like HoloAssist (1.8K).result 90%
• A diffusion model architecture with separate text encoders for left-hand, right-hand, and bimanual interaction prompts improves performance over simple concatenation.technical 80%
• Existing datasets like CLUTCH and InterHand2.6M lack the precision, diversity, and rich inter-hand contact needed for learning fine-grained bimanual motion from text.limitation 85%
• The proposed benchmark models (diffusion and autoregressive) support versatile conditioning modes for bimanual motion generation.method 80%
• HandX introduces new hand-focused metrics (contact precision, recall, F1) to evaluate hand contact accuracy in generated motions.method 85%

Competitive landscape

Competitor map is still being generated for this paper. Enable generation or check back soon.

Startup potential card