Saltar a detalles del preprintSaltar a PREreviews

PREreviews de GAUGE: When Not to Trust LLM-as-a-Judge in User-Simulated Evaluation of Task-Oriented Agents

1 PREreview

  1. PREreview de Jiayu Long

    This paper studies whether an LLM judge, used with simulated users, can choose the better task-oriented agent. Across 25 agent settings, the judge ranks agents well when their performance differs greatly, but is less reliable when they perform similarly. The paper also shows that a conversation…

    Leer la PREreview de Jiayu Long