Neue Suche
Konferenzpaper | | Peer reviewed Open Access

A Living Lab Architecture for Reproducible Shared Task Experimentation

Autor*innen
Breuer, Timo ; Schaer, Philipp
DOI
10.5283/epub.44953
ISBN-13
#defaultkonferenzband 9783864881725
URN
urn:nbn:de:bvb:355-epub-449533

Weitere Details

Sprache
englisch
Darstellungsform
Text
Seitenbereich
348 - 362

No existing evaluation infrastructure for shared tasks currently supports both reproducible on- and offline experiments. In this work, we present an architecture that ties together both types of experiments with a focus on reproducibility. The readers are provided with a technical description of the infrastructure and details of how to contribute their own experiments to upcoming evaluation tasks.

Zitierstile

Download
 RDF/XML-Format
 JSON-LD-Format
 Turtle-Format
 N3-Format