lm-buddy documentation

LM Buddy is a collection of jobs for finetuning and evaluating open-source (large) language models. The library makes use of YAML-based configuration files as inputs to CLI commands for each job, and tracks input/output data with Weights and Biases artifacts.

Getting Started

• LM Buddy
  • Installation
    • Minimum Python version
  • CLI usage
  • Ray job submission
  • Development

Finetuning

• Finetuning

Evaluation

• Evaluation
  • lm-evaluation-harness
  • Prometheus

Examples

• Working with LM Buddy
• Examples

Indices and tables

• Index

• Module Index

• Search Page