Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter
<p dir="ltr">Several studies examined the leverage of the stance in conversational threads or news articles as a signal for rumor verification. However, none of these studies leveraged the stance of <i>trusted authorities</i>. In this work, we define the task of detecting...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Published: |
2024
|
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513545475981312 |
|---|---|
| author | Fatima Haouari (17100181) |
| author2 | Tamer Elsayed (14777071) |
| author2_role | author |
| author_facet | Fatima Haouari (17100181) Tamer Elsayed (14777071) |
| author_role | author |
| dc.creator.none.fl_str_mv | Fatima Haouari (17100181) Tamer Elsayed (14777071) |
| dc.date.none.fl_str_mv | 2024-01-26T09:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1007/s13278-023-01189-3 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Are_authorities_denying_or_supporting_Detecting_stance_of_authorities_towards_rumors_in_Twitter/29446034 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Information and computing sciences Machine learning Language, communication and culture Linguistics Claims Evidence Stance Fact-checking Social media |
| dc.title.none.fl_str_mv | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p dir="ltr">Several studies examined the leverage of the stance in conversational threads or news articles as a signal for rumor verification. However, none of these studies leveraged the stance of <i>trusted authorities</i>. In this work, we define the task of detecting the stance of authorities towards rumors in Twitter, i.e., whether a tweet from an authority supports the rumor, denies it, or neither. We believe the task is useful to augment the sources of evidence exploited by existing rumor verification models. We construct and release the <i>first </i>Authority STance towards Rumors (AuSTR) dataset, where evidence is retrieved from authority timelines in Arabic Twitter. The collection comprises 811 (rumor tweet, authority tweet) pairs relevant to 292 unique rumors. Due to the relatively limited size of our dataset, we explore the adequacy of existing Arabic datasets of stance towards claims in training BERT-based models for our task, and the effect of augmenting AuSTR with those datasets. Our experiments show that, despite its limited size, a model trained solely on AuSTR with a class-balanced focus loss exhibits a comparable performance to the best studied combination of existing datasets augmented with AuSTR, achieving a performance of 0.84 macro-F1 and 0.78 F1 on debunking tweets. The results indicate that AuSTR can be sufficient for our task without the need for augmenting it with existing stance datasets. Finally, we conduct a thorough failure analysis to gain insights for the future directions on the task.</p><h2>Other Information</h2><p dir="ltr">Published in: Social Network Analysis and Mining<br>License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s13278-023-01189-3" target="_blank">https://dx.doi.org/10.1007/s13278-023-01189-3</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_cb0d9aa8ffb45a8d94706b7deb62d9c1 |
| identifier_str_mv | 10.1007/s13278-023-01189-3 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/29446034 |
| publishDate | 2024 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Are authorities denying or supporting? Detecting stance of authorities towards rumors in TwitterFatima Haouari (17100181)Tamer Elsayed (14777071)Information and computing sciencesMachine learningLanguage, communication and cultureLinguisticsClaimsEvidenceStanceFact-checkingSocial media<p dir="ltr">Several studies examined the leverage of the stance in conversational threads or news articles as a signal for rumor verification. However, none of these studies leveraged the stance of <i>trusted authorities</i>. In this work, we define the task of detecting the stance of authorities towards rumors in Twitter, i.e., whether a tweet from an authority supports the rumor, denies it, or neither. We believe the task is useful to augment the sources of evidence exploited by existing rumor verification models. We construct and release the <i>first </i>Authority STance towards Rumors (AuSTR) dataset, where evidence is retrieved from authority timelines in Arabic Twitter. The collection comprises 811 (rumor tweet, authority tweet) pairs relevant to 292 unique rumors. Due to the relatively limited size of our dataset, we explore the adequacy of existing Arabic datasets of stance towards claims in training BERT-based models for our task, and the effect of augmenting AuSTR with those datasets. Our experiments show that, despite its limited size, a model trained solely on AuSTR with a class-balanced focus loss exhibits a comparable performance to the best studied combination of existing datasets augmented with AuSTR, achieving a performance of 0.84 macro-F1 and 0.78 F1 on debunking tweets. The results indicate that AuSTR can be sufficient for our task without the need for augmenting it with existing stance datasets. Finally, we conduct a thorough failure analysis to gain insights for the future directions on the task.</p><h2>Other Information</h2><p dir="ltr">Published in: Social Network Analysis and Mining<br>License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s13278-023-01189-3" target="_blank">https://dx.doi.org/10.1007/s13278-023-01189-3</a></p>2024-01-26T09:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1007/s13278-023-01189-3https://figshare.com/articles/journal_contribution/Are_authorities_denying_or_supporting_Detecting_stance_of_authorities_towards_rumors_in_Twitter/29446034CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/294460342024-01-26T09:00:00Z |
| spellingShingle | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter Fatima Haouari (17100181) Information and computing sciences Machine learning Language, communication and culture Linguistics Claims Evidence Stance Fact-checking Social media |
| status_str | publishedVersion |
| title | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| title_full | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| title_fullStr | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| title_full_unstemmed | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| title_short | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| title_sort | Are authorities denying or supporting? Detecting stance of authorities towards rumors in Twitter |
| topic | Information and computing sciences Machine learning Language, communication and culture Linguistics Claims Evidence Stance Fact-checking Social media |