Offline Constrained RLHF with Multiple Preference Oracles
Offline Constrained RLHF with Multiple Preference Oracles explores Offline constrained reinforcement learning from human feedback with multiple preference oracles for performance and safety trade-offs.. Commercial viability score: 3/10 in LLM Alignment.
Updated 23 hours ago
BUILDER'S SANDBOX
Build This Paper
Use an AI coding agent to implement this research.
OpenAI CodexAI Agent
Lightweight coding agent in your terminal.
Claude CodeAI Agent
Agentic coding tool for terminal workflows.
AntiGravity IDEScaffolding
AI agent mindset installer and workflow scaffolder.
CursorIDE
AI-first code editor built on VS Code.
VS CodeIDE
Free, open-source editor by Microsoft.
Recommended Stack
Startup Essentials
Estimated $10K - $14K over 6-10 weeks.
See exactly what it costs to build this -- with 3 comparable funded startups.
7-day free trial. Cancel anytime.
Discover the researchers behind this paper and find similar experts.
7-day free trial. Cancel anytime.
Related Papers
- Prior WorkProvable Last-Iterate Convergence for Multi-Objective Safe LLM Alignment via Optimistic Primal-DualViability: 3.0
- Higher ViabilityLearning Optimal and Sample-Efficient Decision Policies with GuaranteesViability: 5.0
- Higher ViabilityGeneral Flexible $f$-divergence for Challenging Offline RL Datasets with Low Stochasticity and Diverse Behavior PoliciesViability: 5.0
- Higher ViabilityPCHC: Enabling Preference Conditioned Humanoid Control via Multi-Objective Reinforcement LearningViability: 7.0
- Higher ViabilityRobust Regularized Policy Iteration under Transition Uncertainty