Advanced SearchSearch Tips
A Novel Journal Evaluation Metric that Adjusts the Impact Factors across Different Subject Categories
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
A Novel Journal Evaluation Metric that Adjusts the Impact Factors across Different Subject Categories
Pyo, Sujin; Lee, Woojin; Lee, Jaewook;
  PDF(new window)
During the last two decades, impact factor has been widely used as a journal evaluation metric that differentiates the influence of a specific journal compared with other journals. However, impact factor does not provide a reliable metric between journals in different subject categories. For example, higher impact factors are given to biology and general sciences than those assigned to other traditional engineering and social sciences. This study initially analyzes the trend of the time series of the impact factors of the journals listed in Journal Citation Reports during the last decade. This study then proposes new journal evaluation metrics that adjust the impact factors across different subject categories. The proposed metrics possibly provides a consistent measure to mitigate the differences in impact factors among subject categories. On the basis of experimental results, we recommend the most reliable and appropriate metric to evaluate journals that are less dependent on the characteristics of subject categories.
Adjusted Impact Factor;Field Normalization;Journal Evaluation;
 Cited by
Althouse, B. M., West, J. D., Bergstrom, C. T., and Bergstrom, T. (2009), Differences in impact factor across fields and over time, Journal of the American Society for Information Science and Technology, 60(1), 27-34. crossref(new window)

Bornmann, L. and Daniel, H. D. (2008), What do citation counts measure? A review of studies on citing behavior, Journal of Documentation, 64(1), 45-80. crossref(new window)

Brody, S. (2013), Impact factor: Imperfect but not yet replaceable, Scientometrics, 96, 255-257. crossref(new window)

Chen, J. and Konstan, J. A. (2010), Conference paper selectivity and impact, Communications of the ACM, 53(6), 79-83. crossref(new window)

Dorta-Gonzalez, P. and Dorta-Gonzalez, M. I. (2012), Comparing journals from different fields of science and social science through a JCR subject categories normalized impact factor, Scientometrics, 95(2), 645-672.

Garfield, E. (1979), Citation indexing-Its theory and application in Science, Technology and Humanities, New York: Wiley and Sons.

Leydesdorff, L. (2012), Alternatives of the journal impact factor I3 and the top-10% of the most highly cited papers, Scientometrics, 92, 355-365. crossref(new window)

Pudovkin, A. I. and Garfield, E. (2012), Rank normalization of impact factors will resolve Vanclay's dilemma with TRIF, Scientometrics, 92, 409-412. crossref(new window)

Simons, K. (2008), The misused impact factor, Science, 322(5899), 165-165. crossref(new window)

Vanclay, J. K. (2011), Impact Factor: outdated artefact or stepping-stone to journal certification?, Scientometrics, 92, 211-238.

Zhang, Z., Cheng, Y., and Liu, N. C. (2014), Comparison of the effect of mean-based method and z-score for field normalization of citations at the level of Web of Science subject categories, Scientometrics, 101, 1679-1693. crossref(new window)

Zitt, M., Ramanana, S., and Bassecoulard, E. (2005), Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation, Scientometrics, 63(2), 373-401. crossref(new window)