Neue Suche
Konferenzpaper | Open Access

The Two Sides of the Coin : (Hallucination Generation and Detection with LLMs as Evaluators for LLMs)

Autor*innen
Bui, Anh Thu Maria ; Brech, Saskia Felizitas ; Hußfeldt, Natalie ; Jennert, Tobias ; Ullrich, Melanie ; Breuer, Timo ; Nikzad Khasmakhi, Narjes ; Schaer, Philipp
ISBN-13
#MODS-ID.bibthk_mods_00013246 #defaultkonferenzband

Weitere Details

Sprache
englisch
Darstellungsform
Text
Seitenbereich
727 - 758
Schlüsselwörter
Ensemble Majority Voting , GPT-3.5 Turbo , GPT-4 , Gemma , Hallucination Detection , Hallucination Generation , LLMs as Evaluators , Llama 3

Hallucination detection in Large Language Models (LLMs) is crucial for ensuring their reliability. This work presents our participation in the CLEF ELOQUENT HalluciGen shared task, where the goal is to develop evaluators for both generating and detecting hallucinated content. We explored the capabilities of four LLMs: Llama 3, Gemma, GPT-3.5 Turbo, and GPT-4, for this purpose. We also employed ensemble majority voting to incorporate all four models for the detection task. The results provide valuable insights into the strengths and weaknesses of these LLMs in handling hallucination generation and detection tasks.

Zitierstile

Download
 RDF/XML-Format
 JSON-LD-Format
 Turtle-Format
 N3-Format