Reconstruction and exploration of large-scale distributed operations—Multimedia tools for evaluation of emergency management response

Sofie Pilemalm, PhD; Dennis Andersson, MS; Niklas Hallberg

doi:10.5055/jem.2008.0043

Authors

Sofie Pilemalm, PhD
Dennis Andersson, MS
Niklas Hallberg

DOI:

https://doi.org/10.5055/jem.2008.0043

Keywords:

reconstruction & exploration, distributed tactical operations, emergency management, evaluation, computer technology

Abstract

This study presents an approach for computersupported reconstruction and exploration (R&E) of distributed tactical operations. The approach involves several steps for constructing a time-synchronized, event-driven multimedia model of the course of events collected from multiple sources in the operational environment and visualizes this model in the F-REX Studio multimedia suite. In this study, the use of R&E and F-REX is explored in large-scale emergency management exercises. The approach’s possibilities, limitations, and needs for modification are first outlined followed by a comparison to traditional quantitative and qualitative data collection methods applied in the same context. It is found that the R&E approach in combination with F-REX has several advantages in relation to the other methods, in terms of avoiding problems of retrospection and in being able to provide an overview of the entire operation based on multiple perspectives—addressing the question “why” something happened rather than “what happened.” Correctly used, multimedia-supported R&E can thereby be used for more solid evaluations of large-scale emergency management exercises and operations, thus contributing to more effective handling of future crises.

Author Biographies

Sofie Pilemalm, PhD

Department of Systems Development and IT Security, Swedish Defence Research Agency (FOI), Sweden.

Dennis Andersson, MS

Department of Systems Development and IT Security, Swedish Defence Research Agency (FOI), Sweden.

Niklas Hallberg

Associate Professor, Department of Systems Development and IT Security, Swedish Defence Research Agency (FOI), Sweden.

References

Thomas A, Kopczak L: From logistics to supply chain management: The path forward in the humanitarian sector. Fritz Institute. 2005. Available at www.fritzinstitute.org/PDFs/Programs/FromLogisticsto.pdf. Accessed January 5, 2008.

Albinsson P-A,Wong W, Pilemalm S, et al.: Using a reconstructionexploration approach to empower cognitive analysis methods: Possibilities and challenges. In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, Orlando, FL, 2005: 224-228.

Wong WBL, Blandford A: Situation awareness in emergency medical dispatch. Int J Hum-Comput Stud. 2004; 61, 421-452.

Morin M, Albinsson P-A: Exploration and context in communication analysis. In Bowers C, Salas E, Jentsch F (eds.): Creating High-Tech Teams: Practical Guidance on Work Performance and Technology. Washington, DC: APA Press, 2005: 89-112.

Andersson D, Pilemalm S, Hallberg H: Evaluation of crisis management operations using reconstruction & exploration. In Proceedings of the International Community on Information Systems for Crisis Management Response and Management (ISCRAM), Washington, DC, 2008.

Morin M: Multimedia representations of Distributed Tactical Operations. Dissertation No. 771, Linköping University, Sweden, 2002.

Pigeau R, McCann C: Redefining command and control. In McCann C, Pigeau R (eds.): The Human in Command: Exploring the Modern Military Experience. New York: Kluwer/Plenum, 2000: 163-184.

Byrne D: Interpreting Quantitative Data. London, UK: Sage Publications, 2002.

Baron S, Kruser DS, Huey BM (eds.): Quantitative Modeling of Human Performance in Complex, Dynamic systems, Washington, DC: National Academy Press, 1990.

Denzin NK, Lincoln YS (eds.): Handbook of Qualitative Research. Thousand Oaks: Sage Publications, CA, 2000.

Flanagan, JC: The critical incident technique. Ment Bull. 1954; 51, 327-358.

Dean PJ: A qualitative method of assessment and analysis for changing the organizational culture. Perform Improv. 1998; 2(37): 14-23.

Hoffman RR, Crandall B, Shadbolt N: Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Hum Factors.1998; 40(2), 254-276.

Beyer H, Holtzblatt K: Contextual design. Interactions. 1996; (1): 32-42.

Woods DD: Process-tracing methods for the study of cognition outside of the experimental psychology laboratory. In Klein GA, Orasanu J, Calderwood R. (eds.): Decision Making in Action: Models and Methods. Norwood, NJ: Ablex, 1993: 228-251.

Sanderson P, Scott J, Johnston T, et al.: MacSHAPA and the enterprise of exploratory sequential data analysis (ESDA). Int J Hum-Comput Stud. 1994; 41: 633-681.

Mackay WE, Beaudouin-Lafon M: DIVA: Exploratory data analysis with multimedia streams. In Proceedings of the International Conference for Human Computer Interaction, Los Angeles, CA, 1998: 416-423.

Vasend G: After action review system development trends. In Proceedings of the 27th Conference on Winter Simulation, Arlington, VA, 1995; 1262-1266.

Darling MJ, Parry CS: After-action-reviews: Linking reflection and planning in a learning practice. Reflections. 2001; 2(3): 64-72.

Allen G, Smith R: After action review in military training simulations. In Proceedings of the 26th Conference on Winter Simulation, Orlando, FL, 1994.

Gratch J, Mao W: Automating after-action-review: Attributing blame or credit in team training. In Proceedings of the 12th Conference on Behavior Representation in Modeling and Simulation, Scotsdale, AZ, 2003.

Ford R, Gallagher V, Giuli R. et al.: The JTEP takehome package: An AAR tool for distributed training. In Proceedings of IEEE 2004 Fall Simulation Interoperability Workshop, Orlando, FL, 2004.

Stake RE: Case Studies. In Denzin NK, Lincoln YS. (eds.): Handbook of Qualitative Research. Thousand Oaks, CA: Sage Publications, 2000, 435-454.

Yin RK: Case Study Research. Design and Methods. Thousand Oaks, CA: Sage Publications, 1994:1.

Bernard, RH: Social Research Methods. Qualitative and Quantitative Approaches. Thousand Oaks, CA: Sage Publications, 2000.

Taylor SJ, Bogdan R: Introduction to Qualitative Research Methods. New York:Wiley, 1998.

Seidman I: Interviewing as Qualitative Research. A Guide for Researchers in Education and the Social Sciences. New York: Teachers College Press, 1998.

Stewart DW, Shamdasami PM: Focus Groups. Theory and Practice. Sage Publications, 1990.

Thorstensson M, Albinsson P-A, Johansson M, et al.: MARULK 2006—Utvecklingsmetoder för funktioner, förband och system [MARULK 2006—Development Methods for Functions, Military Units and Systems]. Linköping, Sweden: FOI-T-2188-SE, 2006.

Courtney JD: Automatic, object-based indexing for assisted analysis of video data. In Proceedings of the 4th ACM international conference on Multimedia, Boston, MA, 1996: 423-424.

Kiekel PA, Cooke NJ, Foltz PW, et al.: Some promising results of communication-based automatic measures of team cognition. In Proceedings of the Human Factors and Ergonomic Society 46th Annual Meeting, Santa Monica, CA, 2002: 298-302.