Journal of the Korean Society for Library and Information Science (한국문헌정보학회지)

Korean Society For Library And Information Science (한국문헌정보학회)
권호 표지
DOI QR코드

DOI QR Code

Looking Beyond the Numbers: Bibliometric Approach to Analysis of LIS Research in Korea

  • Yang, Kiduk (Department of Library and Information Science, Kyungpook National University) ;
  • Lee, Jongwook (School of Information, Florida State University) ;
  • Choi, Wonchan (School of Business, Worcester Polytechnic Institute)
  • Received : 2015.10.22
  • Accepted : 2015.11.03
  • Published : 2015.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Bibliometric analysis for research performance evaluation can generate erroneous assessments for various reasons. Application of the same evaluation metric to different domains, for instance, can produce unfair evaluation results, while analysis based on incomplete data can lead to incorrect conclusions. This study examines bibliometric data of library and information science (LIS) research in Korea to investigate whether research performance should be evaluated in a uniform manner in multi-disciplinary fields such as LIS and how data incompleteness can affect the bibliometric assessment outcomes. The initial analysis of our study data, which consisted of 4,350 citations to 1,986 domestic papers published between 2001 and 2010 by 163 LIS faculty members in Korea, showed an anomalous citation pattern caused by data incompleteness, which was addressed via data projection based on past citation trends. The subsequent analysis of augmented study data revealed ample evidence of bibliometric pattern differences across subject areas. In addition to highlighting the need for a subject-specific assessment of research performance, the study demonstrated the importance of rigorous analysis and careful interpretation of bibliometric data by identifying and compensating for deficiencies in the data source, examining per capita as well as overall statistics, and considering various facets of research in order to interpret what the numbers reflect rather than merely taking them at face value as quantitative measures of research performance.

Keywords

References

  1. Adkins, D. and Budd, J. 2006. "Scholarly Productivity of U.S. LIS Faculty." Library & Information Science Research, 28: 374-389. https://doi.org/10.1016/j.lisr.2006.03.021
  2. Blessinger, K. and Hrycaj, P. 2010. "Highly Cited Articles in Library and Information Science: An Analysis of Content and Authorship Trends." Library & Information Science Research, 32: 156-162. https://doi.org/10.1016/j.lisr.2009.12.007
  3. Cronin, B. 2005. "The Reward System" in the Hand of Science: Academic Writing and Its Rewards. Lanham, MD: Scarecrow Press.
  4. Landis, J. R. and Koch, G. G. 1977. "The Measurement of Observer Agreement for Categorical Data." Biometrics, 33(1): 159-174. https://doi.org/10.2307/2529310
  5. Lee, J. and Choi, W. 2013. "Difference in Citation Rates by Subject Areas of LIS in Korea." In Proceedings of the 76th ASIS&T Annual Meeting, 50(1): 1-4.
  6. Li, J. et al. 2010. "Ranking of Library and Information Science Researchers: Comparison of Data Sources for Correlating Citation Data, and Expert Judgments." Journal of Informetrics, 4(4): 554-563. https://doi.org/10.1016/j.joi.2010.06.005
  7. Meho, L. I. and Yang, K. 2007. "Impact of Data Sources on Citation Counts and Rankings of LIS Faculty: Web of Science vs. Scopus and Google Scholar." Journal of the American Society for Information Science and Technology, 58(13): 2105-2125. https://doi.org/10.1002/asi.20677
  8. Norris, M. and Oppenheim, C. 2010. "Peer Review and the h-index: Two Studies." Journal of Informetrics, 4(3): 221-232. https://doi.org/10.1016/j.joi.2009.11.001
  9. Oh, S. 2005. "A Study on the Research Trends of Library & Information Science in Korea by Analyzing Journal Articles and the Cited Literatures." Journal of the Korean Society for Information Management, 22(3): 379-408. https://doi.org/10.3743/KOSIM.2005.22.3.379
  10. Park, J. and Song, M. 2013. "A Study on the Research Trends in Library and Information Science in Korea Using Topic Modeling." Journal of the Korean Society for Information Management, 30(1): 7-27. https://doi.org/10.3743/KOSIM.2013.30.1.007
  11. Saracevic, T. 1999. "Information Science." Journal of the American Society for Information Science and Technology, 50(12): 1051-1063. https://doi.org/10.1002/(SICI)1097-4571(1999)50:12<1051::AID-ASI2>3.0.CO;2-Z
  12. Shaw, D. and Vaughan, L. 2008. "Publication and Citation Patterns among LIS Faculty: Profiling a "Typical Professor"." Library and Information Science Research, 30: 47-55. https://doi.org/10.1016/j.lisr.2007.07.002
  13. Slyder, J. B. et al. 2011. "Citation Pattern and Lifespan: A Comparison of Discipline, Institution, and Individual." Scientometrics, 89(3): 955-966. https://doi.org/10.1007/s11192-011-0467-x
  14. Yang, K. and Lee, J. 2012. "Analysis of Publication Patterns in Korean Library and Information Science Research." Scientometrics, 93(2): 233-251. https://doi.org/10.1007/s11192-012-0663-3
  15. Yang, K and Lee, J. 2013. "Bibliometric Approach to Research Assessment: Publication Count, Citation Count, & Author Rank." Journal of Information Science Theory and Practice, 1(1): 27-41. https://doi.org/10.1633/JISTaP.2013.1.1.2
  16. Yang, K., Lee, J. and Choi, W. submitted. "Publication and Citation Patterns of Korean LIS Research by Subject Areas." Malaysian Journal of Library & Information Science. Manuscript submitted for publication.
  17. Vieira, E. S. and Gomes, J. A. 2010. "Citations to Scientific Articles: Its Distribution and Dependence on the Article Features." Journal of Informetrics, 4: 1-13. https://doi.org/10.1016/j.joi.2009.06.002
  18. Wu, D. et al. 2012. "The State of iSchools: An Analysis of Academic Research and Graduate Education." Journal of Information Science, 38(1): 15-36. https://doi.org/10.1177/0165551511426247