International Journal of Knowledge Content Development & Technology

  • 제5권1호
  • /
  • Pages.15-32
  • /
  • 2015
  • /
  • 2234-0068(pISSN)
  • /
  • 2287-187X(eISSN)
건국대학교 지식콘텐츠연구소 (Research Institute for Knowledge Content Development & Technology)
권호 표지
DOI QR코드

DOI QR Code

Blog Citations as Indicators of the Societal Impact of Research: Content Analysis of Social Sciences Blogs

  • Jamali, Hamid R. (Department of Library and Information Studies, Faculty of Psychology and Education, Kharazmi University) ;
  • Alimohammadi, Dariush (Department of Library and Information Studies, Faculty of Psychology and Education, Kharazmi University)
  • 투고 : 2014.09.19
  • 심사 : 2015.04.12
  • 발행 : 2015.06.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

This article analyzes motivations behind social sciences blog posts citing journal articles in order to find out whether blog citations are good indicators for the societal impact or benefits of research. A random sample of 300 social sciences blog posts (out of 1,233 blog posts) from ResearchBlogging.org published between 01/01/2012 to 18/06/2014 were subjected to content analysis. The 300 blog posts had 472 references including 424 journal articles from 269 different journals. Sixty-one (22.68%) of all cited journals were from the social sciences and most of the journals with high frequency were highly cited general science journals such as PNAS and Science. Seventy-five percent of all journals were referenced only once. The average age of articles cited at the time of citation was 5.8 years. Discussion and criticism were the two main categories of motivations. Overall, the study shows the potential of blog citations as an altmetric measure and as a proxy for assessing the research impact. A considerable number of citation motivations in blogs such as disputing a belief, suggesting policies, providing a solution to a problem, reacting to media, criticism and the like seemed to support gaining societal benefits. Societal benefits are considered as helping stimulate new approaches to social issues, or informing public debate and policymaking. Lower self-citation (compared to some other altmetric measures such as tweets) and the fact that blogging involves generating content (i.e. an intellectual process) give them an advantage for altmetrics. However, limitations and contextual issues such as disciplinary differences and low uptake of altmetrics, in general, in scholarly communication should not be ignored when using blogs as a data source for altmetrics.

키워드

참고문헌

  1. Bar-Ilan, J. (2005). Information hub blogs. Journal of Information Science, 31(4), 297-307. https://doi.org/10.1177/0165551505054175
  2. Boaz, A., Fitzpatrick, S., & Shaw, B. (2008). Assessing the impact of research on policy: A review of the literature for a project on bridging research and policy through outcome evaluation. Policy Studies Institute & King's College London, February. Available at Retrieved 2014.08.20.
  3. Bornman, L. (2012). Measuring the societal impact of research. EMBO Reports, 13(8), 673-676. https://doi.org/10.1038/embor.2012.99
  4. Bornmann, L. (2015). Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics. Scientometrics. In press, DOI: 10.1007/s11192-015-1565-y
  5. Brutscher, P-B., Wooding, S., & Grant, J. (2008). Health Research Evaluation Frameworks: an international comparison. California, Santa Monica: RAND Corporation.
  6. Case, D. O., & Higgins, G. M. (2000). How can we investigate citation behavior? A study of reasons for citing literature in communication. Journal of the American Society for Information Science, 51(7), 635-645. https://doi.org/10.1002/(SICI)1097-4571(2000)51:7<635::AID-ASI6>3.0.CO;2-H
  7. Cochran, W. G. (1977). Sampling techniques (3rd ed.). New York: John Wiley & Sons.
  8. Costas, R., Zahedi, Z., & Wouters, P. (2014). Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. arXiv preprint arXiv:1401.4321. Available at Retrieved 2014.08.20.
  9. Eysenbach, G. (2011). Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. Journal of Medical Internet Research, 13(4), e123. https://doi.org/10.2196/jmir.2012
  10. Groth, P., & Gurney, T. (2010). Studying Scientific Discourse on the Web using Bibliometrics: A Chemistry Blogging Case Study. In: Proceedings of the WebSci10, Raleigh, NC, US. Available: Available at Retrieved 2015.03.30.
  11. Haustein, S., Bowman, T. D., Holmberg, K., Peters, I., & Lariviere, V. (2014a). Astrophysicists on Twitter: An in-depth analysis of tweeting and scientific publication behavior. Aslib Journal of Information Management, 66(3), 279-296. https://doi.org/10.1108/AJIM-09-2013-0081
  12. Haustein, S., Peters, I., Sugimoto, C. R., Thelwall, M., & Lariviere, V. (2014b). Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology, 65(4), 656-669. https://doi.org/10.1002/asi.23101
  13. Holmberg, K., & Thelwall, M. (2014). Disciplinary differences in Twitter scholarly communication. Scientometrics, 101(2), 1027-1042. https://doi.org/10.1007/s11192-014-1229-3
  14. Jamali, H. R., & Nikzad, M. (2011). Article title type and its relation with the number of downloads and citations. Scientometrics, 88(2), 653-661. https://doi.org/10.1007/s11192-011-0412-z
  15. Kapseon, K. (2004). The motivation for citing specific references by social scientists in Korea: The phenomenon of co-existing references. Scientometrics, 59(1), 79-93. https://doi.org/10.1023/B:SCIE.0000013300.68224.c6
  16. Kim, S. (2009). Content analysis of cancer blog posts. Journal of the Medical Library Association: JMLA, 97(4), 260-266. https://doi.org/10.3163/1536-5050.97.4.009
  17. Kostoff, R. N. (1995). Research requirements for research impact assessment. Research Policy, 24(6), 869-882. https://doi.org/10.1016/0048-7333(94)00798-5
  18. Marjanovic, S., Hanney, S., & Wooding, S. (2009). A historical reflection on research evaluation studies, their recurrent themes and challenges. California, Santa Monica: RAND Europe Technical Report. Available at Retrieved 2014.08.20.
  19. Nicholas, D., & Rowlands, I. (2011). Social media use in the research workflow. Information Services and Use, 31(1), 61-83. https://doi.org/10.3233/ISU-2011-0623
  20. Priem, J., Parra, C., Piwowar, H., Groth, P., & Waagmeester, A. (2012). Uncovering impacts: a case study in using altmetrics tools. Available at Retrieved 2014.08.20.
  21. Priem, J., Piwowar, H. A., & Hemminger, B. H. (2011). Altmetrics in the wild: An exploratory study of impact metrics based on social media. Available at Retrieved 2014.08.20.
  22. Shema, H., Bar-Ilan, J., & Thelwall, M. (2012). Research blogs and the discussion of scholarly information. PLoS ONE, 7(5), e35869. https://doi.org/10.1371/journal.pone.0035869
  23. Shema, H., Bar-Ilan, J., & Thelwall, M. (2014a). Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics. Journal of the Association for Information Science and Technology, 65(5), 1018-1027. https://doi.org/10.1002/asi.23037
  24. Shema, H., Bar-Ilan, J., & Thelwall, M. (2014b). How is Research Blogged? A Content Analysis Approach. Journal of the Association for Information Science and Technology, (in press). doi: 10.1002/asi.23239.
  25. Shuai, X., Pepe, A., & Bollen, J. (2012). How the scientific community reacts to newly submitted preprints: Article downloads, twitter mentions, and citations. PLoS ONE, 7: e47523. doi: 10.1371/journal.pone.0047523
  26. Thelwall, M., Haustein, S., Lariviere, V., & Sugimoto, C. R. (2013a). Do altmetrics work? Twitter and ten other social web services. PloS one, 8(5), e64841. 10.1371/journal.pone.0064841
  27. Thelwall, M., Tsou, A., Weingart, S., Holmberg, K., & Haustein, S. (2013b). Tweeting links to academic articles. Cybermetrics: International Journal of Scientometrics, Informetrics and Bibliometrics, 17, 1-8.
  28. Thornley, C., Watkinson, A., Nicholas, D., Volentine, R., Jamali, H. R., Herman, E., Allard, S., Levine, K. J., & Tenopir, C. (2015). The role of tust and authority in the citation behaviour of researchers. Information Research, 20(1), accepted in press.
  29. Tohidinasab, F., & Jamali, H. R. (2013). Why and Where Wikipedia is cited in journal articles? Journal of Scientometric Research, 2(3), 231-238. https://doi.org/10.4103/2320-0057.135415

피인용 문헌

  1. Context of altmetrics data matters: an investigation of count type and user category vol.111, pp.1, 2017, https://doi.org/10.1007/s11192-017-2251-z