A Fisher’s Exact Test Justification of the TF–IDF Term-Weighting Scheme

A Fisher’s Exact Test Justification of the TF–IDF Term-Weighting Scheme

<p>Term frequency–inverse document frequency, or TF–IDF for short, is arguably the most celebrated mathematical expression in the history of information retrieval. Conceived as a simple heuristic quantifying the extent to which a given term’s occurrences are concentrated in any one given docum...

Disgrifiad llawn

Wedi'i Gadw mewn:

Manylion Llyfryddiaeth
Prif Awdur:	Paul Sheridan (238106) (author)
Awduron Eraill:	Zeyad Ahmed (6449615) (author), Aitazaz A. Farooque (17541303) (author)
Cyhoeddwyd:	2025
Pynciau:	Virology Environmental Sciences not elsewhere classified Mathematical Sciences not elsewhere classified Foundations Probabilistic explanation Significance testing Text analysis Text retrieval
Tagiau:	Ychwanegu Tag Dim Tagiau, Byddwch y cyntaf i dagio'r cofnod hwn!

Eitemau Tebyg

TF-IDF Value Chart.
gan: Wei Yang (109917)
Cyhoeddwyd: (2025)

ML models performance using TF-IDF.
gan: Amira Turki (22614823)
Cyhoeddwyd: (2025)

Models’ accuracy using TF-IDF features.
gan: Amira Turki (22614823)
Cyhoeddwyd: (2025)

Results of the proposed approach using TF-IDF features.
gan: Amira Turki (22614823)
Cyhoeddwyd: (2025)

LR with TF-IDF parameters and values.
gan: Sidra khalid (22290973)
Cyhoeddwyd: (2025)

The process flow of LR with TF-IDF.
gan: Sidra khalid (22290973)
Cyhoeddwyd: (2025)

SCOLIA25-Jiang_et_al.pdf
gan: International Workshop on Scholarly Information Access (21153161)
Cyhoeddwyd: (2025)

Statistics of search terms and stems. Mean, standard deviation, and range of the number of selected search terms and number of 3 letter word stems derived from these search terms, across testers and clinicopathologic findings in the pilot test of an application for extraction of necropsy data from the Wildbase Pathology Register, DEE.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Comparative evaluation of LLMs on BibSQL-test.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Evaluation of different example selections on BibSQL-test.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Comparative evaluation of LLMs on BibSQL-test with small training set.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Error analysis of the proposed system on BibSQL-test with small training set.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Detailed accuracy of SQL query components on BibSQL-test with small training set.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Detailed statistics of the BibSQL dataset.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Examples of question templates and their corresponding query paths in the BibSQL dataset.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

The overall process of the SoftSimMatch framework.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

End-to-end workflow of the proposed retrieval-augmented Text-to-SQL framework.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Distribution of questions and queries in the BibSQL dataset.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

A multi-hop example from the BibSQL dataset.
gan: Zhenyu Wang (580934)
Cyhoeddwyd: (2025)

Supplementary file 1_Retrieval practice enhances learning in real primary school settings, whether distributed or not.pdf
gan: Laura Franzoi (22018817)
Cyhoeddwyd: (2025)

Violin plot of all application test performance metrics.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Bar charts of false positive misclassifications for tested clinicopathologic findings across all testers.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Bar charts of false negative misclassifications for tested clinicopathologic findings across all testers.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Metrics of application performance. Mean, standard deviation, and range of recall, precision, and calculated F1-score of all four tested clinicopathologic findings across all testers of the application for extraction of necropsy data from the Wildbase Pathology Register, DEE.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Quantification of misclassification categorisation. Misclassification categories quantified across all testers and clinicopathologic findings for false positives and false negatives in a pilot test of the text-mining application; DEE, designed for the rapid retrieval of necropsy data from free-text reports within the Wildbase Pathology Register of Aotearoa New Zealand.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Histogram of TF-IDF values across fertility-related terms.
gan: Jing Xiang (267561)
Cyhoeddwyd: (2025)

Code for calculating tf.idf
gan: Shengshi Zhou (22264300)
Cyhoeddwyd: (2025)

Table of misclassification coding structure. Codes in the left-hand column were given to individual records misclassified by the application according to the false positive and false negative code definitions and examples described.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Clinicopathologic finding descriptions given for each dataset, and reference name of each finding in this study.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Line plots of performance metrics across TFIDF conditions.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Violin plots of performance metrics across all testers.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

Summarised workflow of the ‘Examine’ section of DEE.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

All tester data.
gan: Stefan Saverimuttu (20882325)
Cyhoeddwyd: (2025)

<b>Bridging the Research-Practice Gap: Strengthening Foundational Literacy in the Pacific</b>
gan: Joanne Mosen (14756542)
Cyhoeddwyd: (2025)

<b>Bridging the Research-Practice Gap: Strengthening Foundational Literacy in the Pacific</b>
gan: Priyanka Taneja (22657273)
Cyhoeddwyd: (2025)

Overview of transformer-based language models.
gan: Ariel Soares Teles (12582700)
Cyhoeddwyd: (2025)

Generic architecture of a Multimodal Large Language Model (MLLM), illustrating how modality-specific encoders, a connector, and an LLM backbone jointly process heterogeneous inputs to generate textual or multimodal outputs.
gan: Ariel Soares Teles (12582700)
Cyhoeddwyd: (2025)

Performance metrics of classifiers with TF-IDF vectorizer.
gan: Yasser Filahi (21627240)
Cyhoeddwyd: (2025)

Confusion matrix of RF with TF-IDF Vectorizer.
gan: Yasser Filahi (21627240)
Cyhoeddwyd: (2025)

The confusion matrix of SVM with TF-IDF vectorization.
gan: Yasser Filahi (21627240)
Cyhoeddwyd: (2025)