Publisher : Korean Society for Information Management
DOI : 10.3743/KOSIM.2015.32.4.205
Title & Authors
Discipline Bias of Document Citation Impact Indicators: Analyzing Articles in Korean Citation Index Lee, Jae Yun; Choi, Sanghee;
The impact of a journal is commonly used as the impact of an individual paper within that journal. It is problematic to interpret a journal's impact as a single paper's impact of the journal, so there are several researches to measure a single paper's impact with its own citation counts. This study applied 8 impact indicators to Korean Citation Index database and examined discipline bias of each indicator. Analyzed indicators are simple citation counts, PageRank, f-value, CCI, c-index, single publication h-index, single publication hs-index, and cl-index. PageRank has the least discipline bias at highly ranked papers and journal bias in a discipline. On the contrary, simple citation counts showed strongly biased results toward a certain discipline or a journal. KCI database provides only simple citation counts. It needs to show PageRank (global indicator) to discover influential papers in diverse areas. Furthermore it needs to consider to provide the best of local indicators. Local indicators can be calculated only with papers in users' search results because they uses citation counts of citing papers and the number of references. They are more efficient than global indicators which explore the whole database. KCI should also consider to provide Cl-index (local indicator).
research evaluation;citation indicator;citation network;discipline bias;PageRank;
신은자 (2013). 한국 재료공학 논문의 피인용 영향요인에 관한 연구. 정보관리학회지, 30(1), 131-150. http://dx.doi.org/10.3743/KOSIM.2013.30.1.131 Shin, Eun-Ja (2013). An analysis on the factors affecting the citation in Korean material science articles. Journal of the Korean Society for Information Management, 30(1), 131-150. http://dx.doi.org/10.3743/KOSIM.2013.30.1.131
이재윤 (2006). 연구성과 측정을 위한 h-지수의 개량에 관한 연구. 정보관리학회지, 23(3), 167-186. http://dx.doi.org/10.3743/KOSIM.2006.23.3.167 Lee, Jae Yun (2006). Some improvements on h-index: Measuring research outputs by citations. Journal of the Korean Society for Information Management, 23(3), 167-186. http://dx.doi.org/10.3743/KOSIM.2006.23.3.167
이재윤 (2011a). 인용 네트워크 분석에 근거한 문헌 인용 지수 연구. 한국문헌정보학회지, 45(2), 119-143. http://dx.doi.org/10.4275/KSLIS.2011.45.2.119 Lee, Jae Yun (2011a). A study on document citation indicators based on citation network analysis. Journal of the Korean Society for Library and Information Science, 45(2), 119-143. http://dx.doi.org/10.4275/KSLIS.2011.45.2.119
이재윤 (2011b). 단일 문헌의 인용 영향력 측정 방식의 개선. 제18회 한국정보관리학회 학술대회 발표논문집, 119-143. Lee, Jae Yun (2011b). Improved methods for assessing single paper's citation impact. Proceedings of the 18th Annual Conference of the Korean Society for Information Management, 119-143.
정영미, 이재윤 (2001). 지식 분류의 자동화를 위한 클러스터링 모형 연구. 정보관리학회지, 18(2), 203-230. Chung, Young-Mee, & Lee, Jae-Yun (2001). Development of a clustering model for automatic knowledge classification. Journal of the Korean Society for Information Management, 18(2), 203-230.
Bi, H. H., Wang, J., & Lin, D. K. J. (2011). Comprehensive citation index for research networks. IEEE Transactions on Knowledge and Data Engineering, 23(8), 1274-1278. http://doi.org/10.1109/TKDE.2010.167
Bornmann, L., Schier, H., Marx, W., & Daniel, H.-D. (2011). Does the h index for assessing single publications really work? A case study on papers published in chemistry. Scientometrics, 89(3), 835-843. http://dx.doi.org/10.1007/s11192-011-0472-0
Egghe, L. (2010). On the relation between Schubert's h-index of a single paper and its total number of received citations. Scientometrics, 84(1), 115-117. http://dx.doi.org/10.1007/s11192-009-0062-6
Fragkiadaki, E., Evangelidis, G., Samaras, N., & Dervos, D. A. (2011). f-Value: Measuring an article's scientific impact. Scientometrics, 86(3), 671-686. http://dx.doi.org/10.1007/s11192-010-0302-9
Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569-16572. http://doi.org/10.1073/pnas.0507655102
Page, L., Brin, S., Motwani, R., & Winograd, T. (1999). The PageRank citation ranking: Bringing order to the Web. Technical Report. Stanford InfoLab. Retrieved from http://ilpubs.stanford.edu:8090/422/
Schubert, A. (2009). Using the h-index for assessing single publications. Scientometrics, 78(3), 559-565. http://doi.org/10.1007/s11192-008-2208-3
Singhal, A., Salton, G., Mitra, M., & Buckley, C. (1996). Document length normalization. Information Processing & Management, 32(5), 619-633.
San Francisco Declaration on Research Assessment: Putting science into the assessment of research. Retrieved from http://www.ascb.org/dora/
Thor, A., & Bornmann, L. (2011). The calculation of the single publication h index and related performance measures: A web application based on Google Scholar data. Online Information Review, 35(2), 291-300. http://dx.doi.org/10.1108/14684521111128050