Dimensions overall score 4.0

GitHub Code Pulse

No public code linked for this paper yet.

• Model merging is highly effective when all source models are homogeneous (derived from the same pretrained backbone).technical 90%
• Direct weight-space fusion becomes ill-posed in heterogeneous settings due to architectural mismatch, latent basis misalignment, and amplified cross-source conflict.limitation 85%
• HeteroFusion consists of two key components: topology-based alignment and conflict-aware denoising.method 95%
• Topology-based alignment transfers knowledge by matching functional module structures instead of raw tensor coordinates.method 90%
• Conflict-aware denoising suppresses incompatible or noisy transfer signals during fusion.method 90%
• Preserving the target adapter basis while predicting structured updates leads to a stable and well-conditioned transfer process.technical 85%
• HeteroFusion consistently outperforms strong merging, fusion, and ensemble baselines across multiple settings.result 80%
• The assumption of homogeneous models is increasingly unrealistic in open model ecosystems where experts are built on different families like Llama, Qwen, and Mistral.market 75%

Competitive landscape

Competitor map is still being generated for this paper. Enable generation or check back soon.

Startup potential card