Studying effectiveness of Web search for fact checking
<p>Web search is commonly used by fact checking systems as a source of evidence for claim verification. In this work, we demonstrate that the task of retrieving pages <em>useful</em> for fact checking, called <em>evidential pages</em>, is indeed <em>different</...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | |
| منشور في: |
2023
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513566130831360 |
|---|---|
| author | Maram Hasanain (14777068) |
| author2 | Tamer Elsayed (14777071) |
| author2_role | author |
| author_facet | Maram Hasanain (14777068) Tamer Elsayed (14777071) |
| author_role | author |
| dc.creator.none.fl_str_mv | Maram Hasanain (14777068) Tamer Elsayed (14777071) |
| dc.date.none.fl_str_mv | 2023-03-16T06:18:41Z |
| dc.identifier.none.fl_str_mv | 10.1002/asi.24577 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Studying_effectiveness_of_Web_search_for_fact_checking/22257526 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Information and computing sciences Data management and data science Library and Information Sciences Information Systems and Management Computer Networks and Communications Information Systems |
| dc.title.none.fl_str_mv | Studying effectiveness of Web search for fact checking |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p>Web search is commonly used by fact checking systems as a source of evidence for claim verification. In this work, we demonstrate that the task of retrieving pages <em>useful</em> for fact checking, called <em>evidential pages</em>, is indeed <em>different</em> from the task of retrieving topically relevant pages that are typically optimized by search engines; thus, it should be handled differently. We conduct a comprehensive study on the performance of retrieving evidential pages over a test collection we developed for the task of re-ranking Web pages by usefulness for fact-checking. Results show that pages (retrieved by a commercial search engine) that are topically relevant to a claim are not always useful for verifying it, and that the engine's performance in retrieving evidential pages is weakly correlated with retrieval of topically relevant pages. Additionally, we identify types of evidence in evidential pages and some linguistic cues that can help predict page usefulness. Moreover, preliminary experiments show that a retrieval model leveraging those cues has a higher performance compared to the search engine. Finally, we show that existing systems have a long way to go to support effective fact checking. To that end, our work provides insights to guide design of better future systems for the task. </p> <h2>Other Information</h2> <p>Published in: Journal of the Association for Information Science and Technology<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br> See article on publisher's website: <a href="http://dx.doi.org/10.1002/asi.24577" target="_blank">http://dx.doi.org/10.1002/asi.24577</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_5650bcffe1b3fb396818dd521512f61f |
| identifier_str_mv | 10.1002/asi.24577 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/22257526 |
| publishDate | 2023 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Studying effectiveness of Web search for fact checkingMaram Hasanain (14777068)Tamer Elsayed (14777071)Information and computing sciencesData management and data scienceLibrary and Information SciencesInformation Systems and ManagementComputer Networks and CommunicationsInformation Systems<p>Web search is commonly used by fact checking systems as a source of evidence for claim verification. In this work, we demonstrate that the task of retrieving pages <em>useful</em> for fact checking, called <em>evidential pages</em>, is indeed <em>different</em> from the task of retrieving topically relevant pages that are typically optimized by search engines; thus, it should be handled differently. We conduct a comprehensive study on the performance of retrieving evidential pages over a test collection we developed for the task of re-ranking Web pages by usefulness for fact-checking. Results show that pages (retrieved by a commercial search engine) that are topically relevant to a claim are not always useful for verifying it, and that the engine's performance in retrieving evidential pages is weakly correlated with retrieval of topically relevant pages. Additionally, we identify types of evidence in evidential pages and some linguistic cues that can help predict page usefulness. Moreover, preliminary experiments show that a retrieval model leveraging those cues has a higher performance compared to the search engine. Finally, we show that existing systems have a long way to go to support effective fact checking. To that end, our work provides insights to guide design of better future systems for the task. </p> <h2>Other Information</h2> <p>Published in: Journal of the Association for Information Science and Technology<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br> See article on publisher's website: <a href="http://dx.doi.org/10.1002/asi.24577" target="_blank">http://dx.doi.org/10.1002/asi.24577</a></p>2023-03-16T06:18:41ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1002/asi.24577https://figshare.com/articles/journal_contribution/Studying_effectiveness_of_Web_search_for_fact_checking/22257526CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/222575262023-03-16T06:18:41Z |
| spellingShingle | Studying effectiveness of Web search for fact checking Maram Hasanain (14777068) Information and computing sciences Data management and data science Library and Information Sciences Information Systems and Management Computer Networks and Communications Information Systems |
| status_str | publishedVersion |
| title | Studying effectiveness of Web search for fact checking |
| title_full | Studying effectiveness of Web search for fact checking |
| title_fullStr | Studying effectiveness of Web search for fact checking |
| title_full_unstemmed | Studying effectiveness of Web search for fact checking |
| title_short | Studying effectiveness of Web search for fact checking |
| title_sort | Studying effectiveness of Web search for fact checking |
| topic | Information and computing sciences Data management and data science Library and Information Sciences Information Systems and Management Computer Networks and Communications Information Systems |