Ranking variants of our study.
<div><p>This study examines the impact of methodological variations in publication-based rankings on the evaluation of individual research performance in business administration. Drawing on a unique dataset comprising complete personal publication lists of 233 professors from Austrian pu...
Bewaard in:
| Hoofdauteur: | |
|---|---|
| Andere auteurs: | , |
| Gepubliceerd in: |
2025
|
| Onderwerpen: | |
| Tags: |
Voeg label toe
Geen labels, Wees de eerste die dit record labelt!
|
| _version_ | 1849927628111216640 |
|---|---|
| author | Gerhard Reichmann (17972544) |
| author2 | Christian Schlögl (411031) Margit Sommersguter-Reichmann (22683462) |
| author2_role | author author |
| author_facet | Gerhard Reichmann (17972544) Christian Schlögl (411031) Margit Sommersguter-Reichmann (22683462) |
| author_role | author |
| dc.creator.none.fl_str_mv | Gerhard Reichmann (17972544) Christian Schlögl (411031) Margit Sommersguter-Reichmann (22683462) |
| dc.date.none.fl_str_mv | 2025-11-25T18:30:05Z |
| dc.identifier.none.fl_str_mv | 10.1371/journal.pone.0336492.t004 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/dataset/Ranking_variants_of_our_study_/30713970 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Medicine Sociology Immunology Cancer Science Policy Infectious Diseases tier outlets according austrian public universities 2009 &# 8211 enhancing academic visibility methodological stress test individual research performance aligning publication efforts multilingual publication data academic evaluation literature publication ranking specifications leading researchers publish leading researchers academic careers scholars publish research strategy methodological variations data sources publication strategy publication languages researchers navigating career researchers ranking systems ranking journals ranking design jourqual ranking xlink "> wos ), study offers study examines study contributes stable group specification choices significant implications results demonstrate researcher rankings practical guidance many articles leveraging comprehensive language publications journals indexed journal qualities highly ranked findings underscore career advancement business administration based rankings article lengths 233 professors 2018 ), |
| dc.title.none.fl_str_mv | Ranking variants of our study. |
| dc.type.none.fl_str_mv | Dataset info:eu-repo/semantics/publishedVersion dataset |
| description | <div><p>This study examines the impact of methodological variations in publication-based rankings on the evaluation of individual research performance in business administration. Drawing on a unique dataset comprising complete personal publication lists of 233 professors from Austrian public universities (2009–2018), we apply ten distinct ranking variants that differ in their treatment of data sources, co-authorship, publication languages, article lengths, and journal qualities. These variants are categorized into purely quantity-focused and predominantly quality-focused rankings. Our results demonstrate that researcher rankings are susceptible to specification choices. While quantity-focused rankings produce relatively small performance differentials and high variability, quality-focused variants consistently identify a stable group of leading researchers. These scholars publish more frequently in English, in journals indexed by Web of Science (WoS), and in top-tier outlets according to the JOURQUAL ranking. Notably, leading researchers publish over twice as many articles in high-ranking journals as their peers. The findings underscore the significant implications of ranking design for career advancement and research strategy. For early-career researchers, aligning publication efforts with the logic of quality-focused rankings—favoring English-language publications in highly ranked, peer-reviewed journals—is crucial for enhancing academic visibility and competitiveness. Moreover, our study offers a methodological stress test for ranking systems, revealing the extent to which technical design influences outcomes. By leveraging comprehensive and multilingual publication data and systematically comparing multiple ranking methodologies, this study contributes to both the academic evaluation literature and practical guidance for researchers navigating the demands of a metric-driven academic environment.</p></div> |
| eu_rights_str_mv | openAccess |
| id | Manara_cdc3ce5f7fa48ace0f9745161511716b |
| identifier_str_mv | 10.1371/journal.pone.0336492.t004 |
| network_acronym_str | Manara |
| network_name_str | ManaraRepo |
| oai_identifier_str | oai:figshare.com:article/30713970 |
| publishDate | 2025 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Ranking variants of our study.Gerhard Reichmann (17972544)Christian Schlögl (411031)Margit Sommersguter-Reichmann (22683462)MedicineSociologyImmunologyCancerScience PolicyInfectious Diseasestier outlets accordingaustrian public universities2009 &# 8211enhancing academic visibilitymethodological stress testindividual research performancealigning publication effortsmultilingual publication dataacademic evaluation literaturepublication ranking specificationsleading researchers publishleading researchersacademic careersscholars publishresearch strategymethodological variationsdata sourcespublication strategypublication languagesresearchers navigatingcareer researchersranking systemsranking journalsranking designjourqual rankingxlink ">wos ),study offersstudy examinesstudy contributesstable groupspecification choicessignificant implicationsresults demonstrateresearcher rankingspractical guidancemany articlesleveraging comprehensivelanguage publicationsjournals indexedjournal qualitieshighly rankedfindings underscorecareer advancementbusiness administrationbased rankingsarticle lengths233 professors2018 ),<div><p>This study examines the impact of methodological variations in publication-based rankings on the evaluation of individual research performance in business administration. Drawing on a unique dataset comprising complete personal publication lists of 233 professors from Austrian public universities (2009–2018), we apply ten distinct ranking variants that differ in their treatment of data sources, co-authorship, publication languages, article lengths, and journal qualities. These variants are categorized into purely quantity-focused and predominantly quality-focused rankings. Our results demonstrate that researcher rankings are susceptible to specification choices. While quantity-focused rankings produce relatively small performance differentials and high variability, quality-focused variants consistently identify a stable group of leading researchers. These scholars publish more frequently in English, in journals indexed by Web of Science (WoS), and in top-tier outlets according to the JOURQUAL ranking. Notably, leading researchers publish over twice as many articles in high-ranking journals as their peers. The findings underscore the significant implications of ranking design for career advancement and research strategy. For early-career researchers, aligning publication efforts with the logic of quality-focused rankings—favoring English-language publications in highly ranked, peer-reviewed journals—is crucial for enhancing academic visibility and competitiveness. Moreover, our study offers a methodological stress test for ranking systems, revealing the extent to which technical design influences outcomes. By leveraging comprehensive and multilingual publication data and systematically comparing multiple ranking methodologies, this study contributes to both the academic evaluation literature and practical guidance for researchers navigating the demands of a metric-driven academic environment.</p></div>2025-11-25T18:30:05ZDatasetinfo:eu-repo/semantics/publishedVersiondataset10.1371/journal.pone.0336492.t004https://figshare.com/articles/dataset/Ranking_variants_of_our_study_/30713970CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/307139702025-11-25T18:30:05Z |
| spellingShingle | Ranking variants of our study. Gerhard Reichmann (17972544) Medicine Sociology Immunology Cancer Science Policy Infectious Diseases tier outlets according austrian public universities 2009 &# 8211 enhancing academic visibility methodological stress test individual research performance aligning publication efforts multilingual publication data academic evaluation literature publication ranking specifications leading researchers publish leading researchers academic careers scholars publish research strategy methodological variations data sources publication strategy publication languages researchers navigating career researchers ranking systems ranking journals ranking design jourqual ranking xlink "> wos ), study offers study examines study contributes stable group specification choices significant implications results demonstrate researcher rankings practical guidance many articles leveraging comprehensive language publications journals indexed journal qualities highly ranked findings underscore career advancement business administration based rankings article lengths 233 professors 2018 ), |
| status_str | publishedVersion |
| title | Ranking variants of our study. |
| title_full | Ranking variants of our study. |
| title_fullStr | Ranking variants of our study. |
| title_full_unstemmed | Ranking variants of our study. |
| title_short | Ranking variants of our study. |
| title_sort | Ranking variants of our study. |
| topic | Medicine Sociology Immunology Cancer Science Policy Infectious Diseases tier outlets according austrian public universities 2009 &# 8211 enhancing academic visibility methodological stress test individual research performance aligning publication efforts multilingual publication data academic evaluation literature publication ranking specifications leading researchers publish leading researchers academic careers scholars publish research strategy methodological variations data sources publication strategy publication languages researchers navigating career researchers ranking systems ranking journals ranking design jourqual ranking xlink "> wos ), study offers study examines study contributes stable group specification choices significant implications results demonstrate researcher rankings practical guidance many articles leveraging comprehensive language publications journals indexed journal qualities highly ranked findings underscore career advancement business administration based rankings article lengths 233 professors 2018 ), |