Towards fine-grained object-level damage assessment during disasters

<p dir="ltr">Social media can play an important role in current-day disaster management. Images shared from the disaster areas may include objects relevant to operations. If these objects are identified correctly, they can offer a preliminary damage assessment report and situational...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Rizwan Sadiq (15192181) (author)
مؤلفون آخرون: Zainab Akhtar (15192184) (author), Steve Peterson (164692) (author), Katelyn Keegan (15192187) (author), Aya El-Sakka (15192190) (author), Muhammad Imran (282621) (author), Ferda Ofli (8983517) (author)
منشور في: 2023
الموضوعات:
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
_version_ 1864513508210638848
author Rizwan Sadiq (15192181)
author2 Zainab Akhtar (15192184)
Steve Peterson (164692)
Katelyn Keegan (15192187)
Aya El-Sakka (15192190)
Muhammad Imran (282621)
Ferda Ofli (8983517)
author2_role author
author
author
author
author
author
author_facet Rizwan Sadiq (15192181)
Zainab Akhtar (15192184)
Steve Peterson (164692)
Katelyn Keegan (15192187)
Aya El-Sakka (15192190)
Muhammad Imran (282621)
Ferda Ofli (8983517)
author_role author
dc.creator.none.fl_str_mv Rizwan Sadiq (15192181)
Zainab Akhtar (15192184)
Steve Peterson (164692)
Katelyn Keegan (15192187)
Aya El-Sakka (15192190)
Muhammad Imran (282621)
Ferda Ofli (8983517)
dc.date.none.fl_str_mv 2023-04-06T03:00:00Z
dc.identifier.none.fl_str_mv 10.3389/feart.2023.990930
dc.relation.none.fl_str_mv https://figshare.com/articles/journal_contribution/Towards_fine-grained_object-level_damage_assessment_during_disasters/26539495
dc.rights.none.fl_str_mv CC BY 4.0
info:eu-repo/semantics/openAccess
dc.subject.none.fl_str_mv Information and computing sciences
Computer vision and multimedia computation
Data management and data science
object detection
instance segmentation
disaster management
social media
deep learning
disaster object taxonomy
dc.title.none.fl_str_mv Towards fine-grained object-level damage assessment during disasters
dc.type.none.fl_str_mv Text
Journal contribution
info:eu-repo/semantics/publishedVersion
text
contribution to journal
description <p dir="ltr">Social media can play an important role in current-day disaster management. Images shared from the disaster areas may include objects relevant to operations. If these objects are identified correctly, they can offer a preliminary damage assessment report and situational awareness for response and recovery. This research is carried out in collaboration with a Community Emergency Response Team (CERT) to understand the state-of-the-art object detection model’s capability to detect objects in multi-hazard disaster scenes posted on social media. Specifically, 946 images were collected from social media during major earthquake and hurricane disasters. All the images were inspected by trained volunteers from CERT and, 4,843 objects were analyzed for applicability to specific functions in disaster operations. The feedback provided by the volunteers helped determine the existing model’s key strengths and weaknesses and led to the development of a disaster object taxonomy relevant to specific disaster support functions. Lastly, using a subset of classes from the taxonomy, an instance segmentation dataset is developed to fine-tune state-of-the-art models for damage object detection. Empirical analysis demonstrates promising applications of transfer learning for disaster object detection.</p><h2>Other Information</h2><p dir="ltr">Published in: Frontiers in Earth Science<br>License: <a href="https://creativecommons.org/licenses/by/4.0/" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.3389/feart.2023.990930" target="_blank">https://dx.doi.org/10.3389/feart.2023.990930</a></p>
eu_rights_str_mv openAccess
id Manara2_5d9fc50086d8ca5acd192ca73ea13c90
identifier_str_mv 10.3389/feart.2023.990930
network_acronym_str Manara2
network_name_str Manara2
oai_identifier_str oai:figshare.com:article/26539495
publishDate 2023
repository.mail.fl_str_mv
repository.name.fl_str_mv
repository_id_str
rights_invalid_str_mv CC BY 4.0
spelling Towards fine-grained object-level damage assessment during disastersRizwan Sadiq (15192181)Zainab Akhtar (15192184)Steve Peterson (164692)Katelyn Keegan (15192187)Aya El-Sakka (15192190)Muhammad Imran (282621)Ferda Ofli (8983517)Information and computing sciencesComputer vision and multimedia computationData management and data scienceobject detectioninstance segmentationdisaster managementsocial mediadeep learningdisaster object taxonomy<p dir="ltr">Social media can play an important role in current-day disaster management. Images shared from the disaster areas may include objects relevant to operations. If these objects are identified correctly, they can offer a preliminary damage assessment report and situational awareness for response and recovery. This research is carried out in collaboration with a Community Emergency Response Team (CERT) to understand the state-of-the-art object detection model’s capability to detect objects in multi-hazard disaster scenes posted on social media. Specifically, 946 images were collected from social media during major earthquake and hurricane disasters. All the images were inspected by trained volunteers from CERT and, 4,843 objects were analyzed for applicability to specific functions in disaster operations. The feedback provided by the volunteers helped determine the existing model’s key strengths and weaknesses and led to the development of a disaster object taxonomy relevant to specific disaster support functions. Lastly, using a subset of classes from the taxonomy, an instance segmentation dataset is developed to fine-tune state-of-the-art models for damage object detection. Empirical analysis demonstrates promising applications of transfer learning for disaster object detection.</p><h2>Other Information</h2><p dir="ltr">Published in: Frontiers in Earth Science<br>License: <a href="https://creativecommons.org/licenses/by/4.0/" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.3389/feart.2023.990930" target="_blank">https://dx.doi.org/10.3389/feart.2023.990930</a></p>2023-04-06T03:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.3389/feart.2023.990930https://figshare.com/articles/journal_contribution/Towards_fine-grained_object-level_damage_assessment_during_disasters/26539495CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/265394952023-04-06T03:00:00Z
spellingShingle Towards fine-grained object-level damage assessment during disasters
Rizwan Sadiq (15192181)
Information and computing sciences
Computer vision and multimedia computation
Data management and data science
object detection
instance segmentation
disaster management
social media
deep learning
disaster object taxonomy
status_str publishedVersion
title Towards fine-grained object-level damage assessment during disasters
title_full Towards fine-grained object-level damage assessment during disasters
title_fullStr Towards fine-grained object-level damage assessment during disasters
title_full_unstemmed Towards fine-grained object-level damage assessment during disasters
title_short Towards fine-grained object-level damage assessment during disasters
title_sort Towards fine-grained object-level damage assessment during disasters
topic Information and computing sciences
Computer vision and multimedia computation
Data management and data science
object detection
instance segmentation
disaster management
social media
deep learning
disaster object taxonomy