The Geometry of Alignment Collapse: When Fine-Tuning Breaks Safety
The Geometry of Alignment Collapse: When Fine-Tuning Breaks Safety explores Analyzes the geometry of alignment degradation in fine-tuned models to improve predictive safety diagnostics.. Commercial viability score: 1/10 in AI Safety.
BUILDER'S SANDBOX
Build This Paper
Use an AI coding agent to implement this research.
OpenAI CodexAI Agent
Lightweight coding agent in your terminal.
Claude CodeAI Agent
Agentic coding tool for terminal workflows.
AntiGravity IDEScaffolding
AI agent mindset installer and workflow scaffolder.
CursorIDE
AI-first code editor built on VS Code.
VS CodeIDE
Free, open-source editor by Microsoft.
Recommended Stack
Startup Essentials
Estimated $9K - $13K over 6-10 weeks.
See exactly what it costs to build this -- with 3 comparable funded startups.
7-day free trial. Cancel anytime.
Discover the researchers behind this paper and find similar experts.
7-day free trial. Cancel anytime.
Related Papers
- Higher ViabilityNarrow fine-tuning erodes safety alignment in vision-language agentsViability: 5.0
- Higher ViabilityAlignment-Weighted DPO: A principled reasoning approach to improve safety alignmentViability: 6.0
- Higher ViabilityFew Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuningViability: 7.0
- Higher ViabilitySurgery: Mitigating Harmful Fine-Tuning for Large Language Models via Attention SinkViability: 6.0
- Higher ViabilityGR-SAP: Generative Replay for Safety Alignment Preservation during Fine-Tuning
Related Resources
- What are the latest research breakthroughs in automotive AI safety?(question)
- What are the commercial implications of improved LLM interpretability for AI safety and reliability?(question)
- What are the implications of Certified Circuits for AI safety and robustness?(question)
- AI Safety – Use Cases(use_case)