Extraction of actionable information from crowdsourced disaster data
DOI:
https://doi.org/10.5055/jem.2016.0302Keywords:
disaster management, crowdsourced data, actionable information extraction, machine learning, support vector machineAbstract
Natural disasters cause enormous damage to countries all over the world. To deal with these common problems, different activities are required for disaster management at each phase of the crisis. There are three groups of activities as follows: (1) make sense of the situation and determine how best to deal with it, (2) deploy the necessary resources, and (3) harmonize as many parties as possible, using the most effective communication channels.
Current technological improvements and developments now enable people to act as real-time information sources. As a result, inundation with crowdsourced data poses a real challenge for a disaster manager. The problem is how to extract the valuable information from a gigantic data pool in the shortest possible time so that the information is still useful and actionable. This research proposed an actionable-data-extraction process to deal with the challenge. Twitter was selected as a test case because messages posted on Twitter are publicly available. Hashtag, an easy and very efficient technique, was also used to differentiate information.
A quantitative approach to extract useful information from the tweets was supported and verified by interviews with disaster managers from many leading organizations in Thailand to understand their missions. The information classifications extracted from the collected tweets were first performed manually, and then the tweets were used to train a machine learning algorithm to classify future tweets. One particularly useful, significant, and primary section was the request for help category. The support vector machine algorithm was used to validate the results from the extraction process of 13,696 sample tweets, with over 74 percent accuracy. The results confirmed that the machine learning technique could significantly and practically assist with disaster management by dealing with crowdsourced data.
References
UNISDR: The Human Cost of Weather-Related Disasters 1995-2015. Vol 53. Geneva, Switzerland: UNISDR, 2015.
CRED: EM-DAT | The international disasters database website, 2016. Available at http://www.emdat.be/. Accessed March 2, 2016.
FEMA-EMI: The four phases of emergency management, 2012. Available at training.fema.gov/emiweb/downloads/is10_unit3.doc. Accessed March 5, 2016.
Jennex ME: Modeling emergency response systems. In Hawaii International Conference on System Sciences. Piscataway, NJ: IEEE, 2007: 22.
Drabek TE, McEntire DA: Emergent phenomena and the sociology of disaster: Lessons, trends and opportunities from the research literature. Disaster Prev Manag Int J. 2003; 12(2): 97-112.
Helsloot I, Ruitenberg A: Citizen response to disasters: A survey of literature and some practical implications. J Contingencies Cris Manag. 2004; 12(3): 98-111.
Ashish N, Eguchi R, Hegde R, et al.: Situational awareness technologies for disaster response. In Chen H, Reid E, Sinai J, et al. (eds.): Terrorism Informatics. New York, NY: Springer, 2008: 517-544.
Endsley MR: Theoretical underpinnings of situation awareness: A critical review. In Situation Awareness Analysis and Measure ment. Boca Raton, FL: CRC Press, 2000: 3-32.
UNISDR: Sendai Framework for Disaster Risk Reduction 2015-2030. Geneva, Switzerland: UNISDR, 2015.
Heinzelman J, Waters C: Crowdsourcing Crisis Information in Disaster-Affected Haiti. Washington, DC: US Institute of Peace, 2010.
Kamel Boulos MN, Resch B, Crowley DN, et al.: Crowdsourcing, citizen sensing and sensor web technologies for public and environmental health surveillance and crisis management: Trends, OGC standards and application examples. Int J Health Geogr. 2011; 10(1): 67.
Zook M, Graham M, Shelton T, et al.: Volunteered geographic information and crowdsourcing disaster relief: A case study of the Haitian earthquake. World Med Health Policy. 2010; 2(2): 6-32.
Schulz A, Ortmann J, Probst F: Getting user-generated content structured: Overcoming information overload in emergency management. In 2012 IEEE Global Humanitarian Technology Conference. Piscataway, NJ: IEEE, 2012: 143-148.
Lettieri E, Masella C, Radaelli G: Disaster management: Findings from a systematic review. Disaster Prev Manag Int J. 2009; 18(2): 117-136.
Kailes JI, Enders A: Moving beyond “special needs” A function-based framework for emergency management and planning. J Disabil Policy Stud. 2007; 17(4): 230-237.
Norris HF, Stevens PS, Pfefferbaum B, et al.: Community resilience as a metaphor, theory, set of capacities, and strategy for disaster readiness. Am J Community Psychol. 2008; 41(1): 127-150.
Cosgrave J: Decision making in emergencies. Disaster Prev Manag Int J. 1996; 5(4): 28-35.
Kim M, Sharman R, Cook-Cottone PC, et al.: Assessing roles of people, technology and structure in emergency management systems: A public sector perspective. Behav Inf Technol. FEMA, 2012; 31(12): 1147-1160.
UNOCHA: UNDAC Handbook. 6th ed. New York: UNDAC, 2013.
FEMA: A Whole Community Approach to Emergency Management: Principles, Themes, and Pathways for Action. Washington, DC: FEMA, 2011.
Jaeger PT, Shneiderman B, Fleischmann KR, et al.: Community response grids: E-government, social networks, and effective emergency management. Telecomm Policy. 2007; 31: 592-604.
Vieweg SE: Situational Awareness in Mass Emergency: A Behavioral and Linguistic Analysis of Microblogged Communications [PhD thesis]. Boulder: University of Colorado at Boulder, 2012.
Palen L, Vieweg S, Sutton J, et al.: Crisis informatics: Studying crisis in a networked world. Paper presented at Proceedings of the Third International Conference on E-Social Science. Ann Arbor, MI. October 7-9, 2007.
Liu SB: Crisis crowdsourcing framework: Designing strategic configurations of crowdsourcing for the emergency management domain. Comput Support Coop Work. 2014; 23(4-6): 389-443.
Poblet M, García-cuesta E, Casanovas P: Crowdsourcing tools for disaster management: A review of platforms and methods. In AI Approaches to the Complexity of Legal Systems. Heidelberg, Germany: Springer, 2014: 261-274.
Wukich C: Social media use in emergency management. J Emerg Manag. 2015; 13(4): 281-294.
Bennett DM: How do emergency managers use social media platforms? J Emerg Manag. 2014; 12(3): 251-256.
Potts L, Seitzinger J, Jones D, et al.: Tweeting disaster: Hashtag constructions and collisions. In Proceedings of the 29th ACM International Conference on Design of Communication. New York, NY: ACM, 2011: 235-240.
Horita FEA, Degrossi LC, Assis LFFG, et al.: The use of volunteered geographic information and crowdsourcing in disaster management: A systematic literature review. paper presented at Proceedings of the Nineteenth Americas Conference on Information Systems. Chicago, IL, August 15-17, 2013.
Dhavase N: Location identification for crime & disaster events by geoparsing Twitter. In International Conference for Convergence of Technology (I2CT). Piscataway, NJ: IEEE, 2014.
Malmasi S, Dras M: Location mention detection in tweets and microblogs. In PACLING 2015, Pacific Association for Computational Linguistics. Singapore: Springer, 2015: 88-93.
Morstatter F, Gao H, Liu H: Discovering location information in social media. IEEE Data Eng Bull. 2015; 38(2): 4-13.
Weaver AC, Boyle JP, Besaleva LI: Applications and trust issues when crowdsourcing a crisis. In 2012 21st International Conference on Computer Communications and Networks, ICCCN 2012. Munich, Germany: IEEE, 2012: 1-5.
Ushahidi: Ushahidi website. 2016. Available at https://www.ushahidi.com/. Accessed March 2, 2016.
Meier PP: Verifying crowdsourced social media reports for live crisis mapping: An introduction to information forensics. 2011. Available at http://ceulearning.ceu.edu/pluginfile.php/106991/mod_resource/content/1/M4_Meier_Crowdsourced_data-casestudies.pdf. Accessed March 5, 2016.
Morrow N, Mock N, Papendieck A, et al.: Independent evaluation of the ushahidi haiti project. Development Information Systems International 8. 2011.
Ushahidi: Examples of deployments website. Available at https://www.ushahidi.com/support/examples-of-deployments. Accessed December 15, 2015.
Hale J: A layered communication architecture for the support of crisis response. J Manag Inf Syst. 1997; 14(1): 235-255.
Palen L, Anderson KM, Mark G, et al.: A vision for technology-mediated support for public participation & assistance in mass emergencies & disasters. In Proceedings of the 2010 ACM-BCS Visions of Computer Science Conference. Swinton, UK: British Computer Society, 2010: 8.
Simon T, Goldberg A, Adini B: Socializing in emergencies—A review of the use of social media in emergency situations. Int J Inf Manag. 2015; 35(5): 609-619.
Houston JB, Hawthorne J, Perreault MF, et al.: Social media and disasters: A functional framework for social media use in disaster planning, response, and research. Disasters. 2015; 39(1): 1-22.
Yin J, Lampert A, Cameron M, et al.: Using social media to enhance emergency situation awareness. IEEE Intell Syst. 2012; 27(6): 52-59.
Alexander DE: Social media in disaster risk reduction and crisis management. Sci Eng Ethics. 2014; 20(3): 717-733.
Lang G, Benbunan-Fich R: The Use of Social Media in Disaster Situations: Framework and Cases. Hershey, PA: IGI Global, 2010: 11.
Wendling C, Radisch J, Jacobzone S: The Use of Social Media in Risk and Crisis Communication. Vol 30. Paris, France: OECD, 2013.
IRGC: Social Media for Crisis Communication. Lausanne, Switzerland: IRGC, 2012.
UNISDR: Disaster Risk Reduction and Resilience in the 2030 Agenda for Sustainable Development. Geneva, Switzerland: UNISDR, 2015: 1-21.
UNAPCICT: ICT for Disaster Risk Reduction. Incheon: UNAPCICT, 2010.
Vieweg S, Hughes AL, Starbird K, et al.: Microblogging during two natural hazards events: What Twitter may contribute to situational awareness. In CHI 2010. New York, NY: ACM Press, 2010: 1079-1088.
Neubig G, Matsubayashi Y, Hagiwara M, et al.: Safety information mining—What can NLP do in a disaster. In IJCNLP, 2011, Proceedings of the 5th International Joint Conference on Natural Language Processing. Vol. 11. Chiang Mai, Thailand: Asian Federation of Natural Language Processing, 2011: 965-973.
Imran M, Elbassuoni S, Castillo C, et al.: Extracting information nuggets from disaster-related messages in social media. In Proceedings of ISCRAM. Baden-Baden, Germany: ISCRAM Association, 2013: 1-10.
Imran M, Elbassuoni S, Castillo C, et al.: Practical extraction of disaster-relevant information from social media. In Proceedings of the 22nd International Conference on World Wide Web. New York, NY: ACM Press, 2013: 1021-1024.
Lingad J, Karimi S, Yin J: Location extraction from disaster-related microblogs. In Proceedings of the 22nd International Conference on World Wide Web Companion. International World Wide Web Conferences Steering Committee. New York, NY: ACM, 2013: 1017-1020.
Sebastiani F: Machine learning in automated text categorization. ACM Comput Surv. 2002; 34(1): 1-47.
Kotsiantis SB: Supervised machine learning: A review of classification techniques. Informatica. 2007; 31: 249-268.
Powers DM: Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. J Mach Learn Technol. 2011; 2: 37-63.
Valverde-Albacete FJ, Peláez-Moreno C: 100% classification accuracy considered harmful: The normalized information transfer factor explains the accuracy paradox. PLoS One. 2014; 9(1): e84217.
Zocial inc.: Insightful information of Thai people on social media. 2015.
EM-DAT: Disaster profiles website. 2016. Available at http://www.emdat.be/disaster_profiles/index.html. Accessed June 14, 2016.
Machine Learning Group at the University of Waikato: Weka 3 website. Available at http://www.cs.waikato.ac.nz/ml/weka/. Accessed March 2, 2016.
Platt JC: Fast training of support vector machines using sequential minimal optimization. In Advances in Kernel Methods: Support Vector Learning. 1st ed. Cambridge, MA: The MIT Press, 1998: 185-208.
Chang CC, Lin CJ: LIBSVM website. Available at http://www.csie.ntu.edu.tw/∼cjlin/libsvm/. Accessed March 5, 2016.
Debnath R, Takahashi H: Kernel selection for the support vector machine. IEICE Trans Inf Syst. 2004; E87-D(12): 2903-2904.
Published
How to Cite
Issue
Section
License
Copyright 2007-2023, Weston Medical Publishing, LLC and Journal of Emergency Management. All Rights Reserved
