Lab

Lab Notes

DPO

DPO for Tool-use Preference

Turns tool-use issue cases into preference data connecting replay evaluation, policy optimization, and model improvement.

  • DPO
  • Tool-use
  • Preference Data
Read more
Replay Eval

Agent Replay Evaluation Harness

Built reproducible Agent regression evaluation from production traces for prompt, tool, and model changes.

  • Evaluation
  • Replay
  • Regression
Read more