BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMs

BidirLM: From Text to Omnimodal Bidirectional Encoders by Adapting and Composing Causal LLMs explores A novel method to adapt existing causal LLMs into powerful bidirectional encoders for multimodal tasks, outperforming current state-of-the-art.. Commercial viability score: 7/10 in LLM Adaptation.