MeMo: Memory as a Model

Dimensions overall score 9.0

GitHub Code Pulse

No public code linked for this paper yet.

• MeMo achieves strong performance compared to existing methods on BrowseComp-Plus, NarrativeQA, and MuSiQue benchmarks.result 90%
  Evidencepartial

  Our experimental results on three benchmarks, BrowseComp-Plus, NarrativeQA, and MuSiQue, show that MeMo achieves strong performance compared to existing methods across diverse settings.

  Implicationpartial

  Explicitly stated in the abstract with benchmark names.

  Verificationpartial

  partial

• MeMo encodes new knowledge into a dedicated memory model while keeping the LLM parameters unchanged.method 95%
  Evidencepartial

  MeMo (Memory as a Model), a modular framework that encodes new knowledge into a dedicated memory model while keeping the LLM parameters unchanged.

  Implicationpartial

  Directly stated in the abstract and supported by the analysis.

  Verificationpartial

  partial

• MeMo avoids catastrophic forgetting in the LLM.technical 90%
  Evidencepartial

  it avoids catastrophic forgetting in the LLM

  Implicationpartial

  Explicitly listed as an advantage in the abstract.

  Verificationpartial

  partial

• MeMo does not require access to the LLM's weights or output logits, enabling plug-and-play integration with both open and proprietary closed-source LLMs.technical 95%
  Evidencepartial

  it does not require access to the LLM's weights or output logits, enabling plug-and-play integration with both open and proprietary closed-source LLMs

  Implicationpartial

  Directly stated in the abstract.

  Verificationpartial

  partial

• MeMo achieves strong performance compared to existing methods on BrowseComp-Plus, NarrativeQA, and MuSiQue benchmarks.result 90%
  Evidencepartial

  Our experimental results on three benchmarks, BrowseComp-Plus, NarrativeQA, and MuSiQue, show that MeMo achieves strong performance compared to existing methods across diverse settings.

  Implicationpartial

  Stated in the abstract and supported by the analysis mentioning superior performance.

  Verificationpartial

  partial

• MeMo's retrieval cost is independent of corpus size at inference time.technical 90%
  Evidencepartial

  its retrieval cost is independent of corpus size at inference time

  Implicationpartial

  Explicitly listed as an advantage in the abstract.

  Verificationpartial

  partial

• MeMo captures complex cross-document relationships.method 85%
  Evidencepartial

  it captures complex cross-document relationships

  Implicationpartial

  Listed as an advantage in the abstract, but no specific evidence provided in the excerpt.

  Verificationpartial

  partial

• MeMo is robust to retrieval noise.technical 85%
  Evidencepartial

  it is robust to retrieval noise

  Implicationpartial

  Listed as an advantage in the abstract, but no specific evidence provided in the excerpt.

  Verificationpartial

  partial

• Scalability of the memory module with very large corpora is a limitation of MeMo.limitation 80%
  Evidencepartial

  Limitations include the scalability of the memory module with very large corpora and potential costs associated with constructing and maintaining memory infrastructure.

  Implicationpartial

  Mentioned in the analysis caveats, but not explicitly stated in the abstract.

  Verificationpartial

  partial

• MeMo encodes new knowledge into a dedicated memory model while keeping the LLM parameters unchanged.method 95%
  Evidencepartial

  MeMo (Memory as a Model), a modular framework that encodes new knowledge into a dedicated memory model while keeping the LLM parameters unchanged.

  Implicationpartial

  Directly stated in the abstract with clear description.

  Verificationpartial

  partial

• MeMo encodes new knowledge into a dedicated memory model while keeping the LLM parameters unchanged.method 95%
  Evidencepartial

  a modular framework that encodes new knowledge into a dedicated memory model while keeping the LLM parameters unchanged

  Implicationpartial

  Directly stated in the abstract and supported by the analysis.

  Verificationpartial

  partial

• MeMo avoids catastrophic forgetting in the LLM.technical 90%
  Evidencepartial

  it avoids catastrophic forgetting in the LLM

  Implicationpartial

  Explicitly listed as an advantage in the abstract.

  Verificationpartial

  partial

Startup potential card