Evaluation of Tabletop Exercises in Emergency Response Research and Application in the Research Project SORTIE

This paper presents the fields of application of the tabletop exercise in emergency response by explaining the method in emergency response research. The authors illustrate the tabletop exercise of the Institute for Rescue Engineering and Civil Protection (IRG) of the TH Köln in a research project on Sensor Systems for Localization of Trapped Victims in Collapsed Infrastructure (acronym: SORTIE) as an application example. Subsequently, the quantitative and qualitative evaluation methods used generally and specifically for the tabletop exercise of the research project SORTIE are considered, and the technical implementation is explained. The evaluation method used in the tabletop exercise consists of three sub-areas (participant survey; exercise observation; photo, video and audio recordings). Further, the analysis of the evaluation using statistical tools is explained. Finally, this paper refers to possible sources of error in the evaluation of tabletop exercises, such as exercise artificiality and subjectivity of the exercise observers.