The Current Research Status of Complementary and Integrative Medicine in Practice-Based Research Networks: A Systematic Review

개원의중심연구망에서 수행된 보완통합의학 관련 연구 현황: 체계적 문헌고찰

  • Won, Jiyoon (Department of Korean Medical Science, Graduate School, Kyung Hee University) ;
  • Han, Gajin (JINRESEARCH) ;
  • Kim, Yejin (College of Korean Medicine, Kyung Hee University) ;
  • Park, Jae Rang (College of Korean Medicine, Dongguk University) ;
  • Noh, Eunyoung (Department of Medical Science of Meridian, Graduate School, Kyung Hee University) ;
  • Ji, Yu-jin (Department of Medical Science of Meridian, Graduate School, Kyung Hee University) ;
  • Adams, Jon (Australian Research Centre in Complementary and Integrative Medicine, Faculty of Health, University of Technology Sydney) ;
  • Lee, Hyangsook (Department of Korean Medical Science, Graduate School, Kyung Hee University)
  • 원지윤 (경희대학교 대학원 기초한의과학과) ;
  • 한가진 (진리서치) ;
  • 김예진 (경희대학교 한의과대학) ;
  • 박재량 (동국대학교 한의과대학) ;
  • 노은영 (경희대학교 대학원 경락의과학과) ;
  • 지유진 (경희대학교 대학원 경락의과학과) ;
  • 아담스 존 (시드니 공과대학교 호주보완통합의학연구센터) ;
  • 이향숙 (경희대학교 대학원 기초한의과학과)
  • Received : 2020.10.30
  • Accepted : 2020.11.22
  • Published : 2020.12.27


Objectives : Practice-Based Research Networks (PBRNs), collaborations of practitioners and academic researchers, have provided platforms for conducting research to address clinical questions generated from daily routine care. This review aimed to critically analyse articles from PBRNs that are related to complementary and integrative medicine (CIM) and to suggest future directions for a PBRN which is appropriate for Korean Medicine (KM). Methods : PubMed, PBRN registries in Agency for Healthcare Research and Quality and relevant PBRN websites were searched up to November 2019 for research articles from PBRNs that focused on CIM regardless of study design. Methodological quality of the included studies was assessed. The included studies were read in full, classified and summarised according to their topics. Results : A total of 51 articles published from 1998 through 2020 were included in this review. They were categorised into three principal themes based on research questions and findings: health services research (embracing researches examining characteristics of patients and CIM practitioners/practices, and communication between patients and practitioners); effectiveness and safety of CIM practices/interventions; and feasibility studies of instruments and interventions in PBRN settings. The study designs varied including surveys (n=30), prospective observational studies (n=6), 2ndary analyses of existing studies (n=7), protocols (n=7), retrospective chart review (n=1) and qualitative study (n=1). Quality of the included studies greatly varied. Conclusions : PBRNs can serve as a feasible platform for conducting practice-relevant research on KM and CIM. Considering growing demands on evidence-base for routine practice of KM amid various stakeholders, a PBRN in KM community and further researches nested within PBRN designs are warranted.


  1. Agency for Healthcare Research and Quality. [cited May 2017]. Available from URL:
  2. FAQs. [cited Oct 2020]. ]. Available from URL:
  3. Kim YI, Hong JY, Kim K, Goh E, Sung N. Primary care research in South Korea: its importance and enhancing strategies for enhancement. J Korean Med Assoc. 2013 ; 56(10) : 899-907.
  4. Lindbloom EJ, Ewigman BG, Hickner JM. Practice-based research networks: the laboratories of primary care research. Medical care. 2004 ; 42(4 Suppl) : Iii45-9.
  5. Thomas P, Griffiths F, Kai J, O'Dwyer A. Networks for research in primary health care. BMJ. 2001 ; 322(7286) : 588-90.
  6. PBRN Registry. [cited Nov 2016]. Availab le from URL
  7. Descriptive Information about AHRQ Registered Practice-based Research Networks. [cited Oct 2020]. Available from URL:
  8. Genel M, Dobs A. Translating clinical research into practice: practice-b ased research networks--a promising solution. J Investig Med. 2003 ; 51(2) : 64-71.
  9. Steel A, Sibbritt D, Schloss J, Wardle J, Leach M, Diezel H, et al. An Overview of the Practitioner Research and Collaboration Initiative (PRACI): a practice-based research network for complementary medicine. BMC Complement Altern Med. 2017 ; 17(1) : 87.
  10. Jung Y. Introduction to Cheonan primary care research network. J Korean Fam Med. 1998 ; 19 : 1084-7.
  11. Yun ZY, Lee DW, Jung HS, Park KH, Lee SH, Park JJ, et al. Change of Selection to Antihypertensive Drugs in Hypertensive Patients with Diabetes Mellitus: In Pohang. Gyeongju Primary Care Research Network. Korean J Fam Med. 2009 ; 30(3) : 197-201.
  12. Defining the position of Traditional Korean Medicine doctors in primary care. [cited Apr 2020]. Available from URL:
  13. Kim SG, Lee SH, Seo HJ, Baek SM, Choi, SM. Research trend analysis of the prevalence of complementary and alternative medicine in Korea. J Korean Med. 2012 ; 33(1) : 24-41.
  14. Committee on the Use of Complementary and Alternative Medicine by the American Public Board on Health Promotion and Disease. Complementary and Alternative Medicine in the United States. Washington, D.C.: The National Academies Press 2005.
  15. Paterson C, Dieppe P. Characteristic and incidental (placebo) effects in complex interventions such as acupuncture. BMJ. 2005 ; 330(7501) : 1202-5.
  16. Adams J. Researching complementary and alternative medicine: London: Routledge 2007.
  17. Verhoef MJ, Lewith G, Ritenbaugh C, Boon H, Fleishman S, Leis A. Complementary and alternative medicine whole systems research: beyond identification of inadequacies of the RCT. Complement Ther Med. 2005 ; 13(3) : 206-12.
  18. Nutting PA, Beasley JW, Werner JJ. Practice-based research networks answer primary care questions. JAMA. 1999 ; 281(8) : 686-8.
  19. Yearbook of Traditional Korean Medicine Publishing Committee. 2018 Yearbook of Traditonal Korean Medicine. Daejeon: Korea Institute of Oriental Medicine; 2020.
  20. Lee H, Peng W, Steel A, Reid R, Sibbritt D, Adams J. Complementary and alternative medicine research in practice-based research networks: A critical review. Complement Ther Med. 2019 ; 43 : 7-19.
  21. Adams J, Andrews G, Barnes J, et al. Traditional Complementary and Integrative Medicine: An international Reader. Buckinghamshire: Palgrave Macmillan. 2012.
  22. Reid R, Steel A, Wardle J, Trubody A, Adams J. Complementary medicine use by the Australian population: a critical mixed studies systematic review of utilisation, perceptions and factors associated with use. BMC Complement Altern Med. 2016 ; 16 : 176.
  23. Practice-Based Research Networks in the 21st Century - The Pearls of Research. In: Graham R, ed. Proceedings from the Conference Convened by the AAFP Task Force to Enhance Family Practice Research. Leesburg, Virginia: American Academy of Family Physicians. 1998.
  24. Higgins JPT, Altman DG, Gotzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011 ; 343 : d5928.
  25. Critical Appraisal Skills Programme (CASP) Qualitative Research Checklist. [cited May 2017]. Available from URL:
  26. Fejer R, Kyvik KO, Hartvigsen J. The prevalence of neck pain in the world population: a systematic critical review of the literature. Eur Spine J. 2006 ; 15(6) : 834-48.
  27. Peng W, Adams J, Sibbritt DW, Frawley JE. Critical review of complementary and alternative medicine use in menopause: focus on prevalence, motivation, decision-making, and communication. Menopause. 2014 ; 21(5) : 536-48.
  28. Bishop FL, Rea A, Lewith H, Chan YK, Saville J, Prescott P, et al. Complementary medicine use by men with prostate cancer: a systematic review of prevalence studies. Prostate Cancer Prostatic Dis. 2011 ; 14(1) : 1-13.
  29. Harris JK, Beatty KE, Barbero C, Howard AF, Cheskin RA, Shapiro RM, 2nd, et al. Methods in public health services and systems research: a systematic review. Am J Prev Med. 2012 ; 42(5 Suppl 1) : S42-57.
  30. Jo H, Kwon M, Kim J, Jo D, Choi J, Han J, et al. A Review of the Assessment Tools in Clinical Trials for Patients Injured in Traffic Accidents in South Korea. J Acupunct Res. 2016 ; 33(4) : 15-31.
  31. Degenhardt BF, Johnson JC, Gross SR, Hagan C, Lund G, Curry WJ. Preliminary findings on the use of osteopathic manipulative treatment: outcomes during the formation of the practice-based research network, DO-Touch.NET. J Am Osteopathic Assoc. 2014 ; 114(3) : 154-70.
  32. Edman JS, Greeson JM, Roberts RS, Kaufman AB, Abrams DI, Dolor RJ, et al. Perceived Stress in Patients with Common Gastrointestinal Disorders: Associations with Quality of Life, Symptoms and Disease Management. Explore. 2017 ; 13(2) : 124-8.
  33. Yang N, Wolever R, Roberts R, Perlman A, Dolar RJ, Abrams DI, et al. Integrative health care services utilization as a function of body mass index: A BraveNet practice-based research network study. Adv Integr Med. 2017 ; 4(1) : 14-21.
  34. Wolever RQ, Goel NS, Roberts RS, Caldwell K, Kligler B, Dusek JA, et al. Integrative Medicine Patients Have High Stress, Pain, and Psychological Symptoms. Explore. 2015 ; 11(4) : 296-303.
  35. Edman JS, Roberts RS, Dusek JA, Dolor R, Wolever RQ, Abrams DI. Characteristics of cancer patients presenting to an integrative medicine practice-based research network. Integr Cancer Ther. 2014 ; 13(5) : 405-10.
  36. Licciardone JC, Kearns CM, King HH, Seffinger MA, Crow WT, Zajac P, et al. Somatic dysfunction and use of osteopathic manual treatment techniques during ambulatory medical care visits: a CONCORD-PBRN study. J Am Osteopathic Assoc. 2014 ; 114(5) : 344-54.
  37. Alcantara J, Ohm J, Kunz K, Alcantara JD, Alcantara J. The characterisation and response to care of pregnant patients receiving chiropractic care within a practice-based research network. Chiropractic J Aust. 2012 ; 42(2) : 60-7.
  38. Wolever RQ, Abrams DI, Kligler B, Dusek JA, Roberts R, Frye J, et al. Patients seek integrative medicine for preventive approach to optimize health. Explore. 2012 ; 8(6) : 348-52.
  39. Alcantara J. The presenting complaints of pediatric patients for chiropractic care: Results from a practice-based research network. Clin Chiropr. 2008 ; 11(4) : 193-8.
  40. Hawk C, Long CR, Boulanger KT. Prevalence of nonmusculoskeletal complaints in chiropractic practice: report from a practice-based research program. J Manipulative Physiol Ther. 2001 ; 24(3) : 157-69.
  41. Hawk C, Long CR, Boulanger KT. Pateint satisfaction with the chiropractic clinical encounter: Report from a practice-based research program. J Neuromusculosklet Sys. 2001 ; 9(4) : 109-17.
  42. Hawk C, Long CR, Boulanger KT, Morschhauser E, Fuhr AW. Chiropractic care for patients aged 55 years and older: report from a practice-based research program. J Am Geriatr Soc. 2000 ; 48(5) : 534-45.
  43. Alcantara J, Lamont AE, Ohm J, Alcantara J. The Quality of Life of Children Under Chiropractic Care Using PROMIS-25: Results from a Practice-Based Research Network. J Altern Complement Med. 2018 ; 24(4) : 378-84.
  44. Alcantara J, Nazarenko AL, Ohm J, Alcantara J. The Use of the Patient Reported Outcomes Measurement Information System and the RAND VSQ9 to Measure the Quality of Life and Visit-Specific Satisfaction of Pregnant Patients Under Chiropractic Care Utilizing the Webster Technique. J Altern Complement Med. 2018 ; 24(1) : 90-8.
  45. Hawk C, Rand B. "Chiropractors against tobacco" pilot project: A practice-based research study. J Am Chiropr Assoc. 2005 ; 42(4) : 8-15.
  46. Moore C, de Luca K, Wong AYL, Fernandez M, Swain M, Hartvigsen J, et al. Characteristics of chiropractors who manage people aged 65 and older: A nationally representative sample of 1903 chiropractors. Australas J Ageing. 2019 ; 38(4) : 249-57.
  47. Adams J, Lauche R, Peng W, Steel A, Moore C, Amorin-Woods LG, et al. A workforce survey of Australian chiropractic: the profile and practice features of a nationally representative sample of 2,005 chiropractors. BMC Complement Altern Med. 2017 ; 17(1) : 14.
  48. Alcantara J, Leach MJ. Chiropractic Attitudes and Utilization of Evidence-Based Practice: The Use of the EBASE Questionnaire. Explore. 2015 ; 11(5) : 367-76.
  49. Hawk C, Evans M, Rupert R, Ndetan H. Opportunities to integrate prevention into the chiropractic clinical encounter: A practice-based research project by the integrated chiropractic outcomes network (ICON). Top Integrative Health Care. 2011 ; 2(3) : 1-19.
  50. Alcantara J, Ohm J, Kunz D. The chiropractic care of children. J Altern Complement Med. 2010 ; 16(6) : 621-6.
  51. Redwood D, Hawk C, Cambron J, Vinjamury SP, Bedard J. Do chiropractors identify with complementary and alternative medicine? Results of a survey. J Altern Complement Med. 2008 ; 14(4) : 361-8.
  52. Adams J, de Luca K, Swain M, Funabashi M, Wong A, Page I, et al. Prevalence and practice characteristics of urban and rural or remote Australian chiropractors: Analysis of a nationally representative sample of 1830 chiropractors. Aust J Rural Health. 2019 ; 27(1) : 34-41.
  53. Adams J, Sibbritt D, Steel A, Peng W. A workforce survey of Australian osteopathy: analysis of a nationally-representative sample of osteopaths from the Osteopathy Research and Innovation Network (ORION) project. BMC Health Serv Res. 2018 ; 18(1) : 352.
  54. Adams J, Lauche R, de Luca K, Swain M, Peng W, Sibbritt D. Prevalence and profile of Australian chiropractors treating athletes or sports people: A cross-sectional study. Complement Ther Med. 2018 ; 39 : 56-61.
  55. Fernandez M, Moore C, Eklund A, Swain M, de Luca K, Sibbritt D, et al. The prevalence and determinants of physical activity promotion by Australian chiropractors: A cross sectional study. Complement Ther Med. 2019 ; 45 : 172-8.
  56. Fernandez M, Moore C, Peng W, de Luca K, Pohlman KA, Swain M, et al. The profile of chiropractors managing patients with low back-related leg pain: analyses of 1907 chiropractors from the ACORN practice-based research network. Chiropr Man Therap. 2019 ; 27 : 19.
  57. Leach MJ, Sundberg T, Fryer G, Austin P, Thomson OP, Adams J. An investigation of Australian osteopaths' attitudes, skills and utilisation of evidence-based practice: a national crosssectional survey. BMC Health Serv Res. 2019 ; 19(1) : 498.
  58. Lee MK, Amorin-Woods L, Cascioli V, Adams J. The use of nutritional guidance within chiropractic patient management: a survey of 333 chiropractors from the ACORN practice-based research network. Chiropr Man Therap. 2018 ; 26 : 7.
  59. Moore C, Adams J, Leaver A, Lauche R, Sibbritt D. The treatment of migraine patients within chiropractic: analysis of a nationally representative survey of 1869 chiropractors. BMC Complement Altern Med. 2017 ; 17(1) : 519.
  60. Moore C, Leaver A, Sibbritt D, Adams J. The management of common recurrent headaches by chiropractors: a descriptive analysis of a nationally representative survey. BMC Neurol. 2018 ; 18(1) : 171.
  61. Moore C, Leaver A, Sibbritt D, Adams J. Prevalence and factors associated with the use of primary headache diagnostic criteria by chiropractors. Chiropr Man Therap. 2019 ; 27 : 33.
  62. Steel A, Vaughan B, Orrock P, Peng W, Fleischmann M, Grace S, et al. Prevalence and profile of Australian osteopaths treating older people. Complement Ther Med. 2019 ; 43 : 125-30.
  63. Steel A, Leach M, Wardle J, Sibbritt D, Schloss J, Diezel H, et al. The Australian Complementary Medicine Workforce: A Profile of 1,306 Practitioners from the PRACI Study. J Altern Complement Med. 2018 ; 24(4) : 385-94.
  64. Steel A, Peng W, Sibbritt D, Adams J. Introducing national osteopathy practice-based research networks in Australia and New Zealand: an overview to inform future osteopathic research. Sci Rep. 2020 ; 10(1) : 846.
  65. Stilwell P, Hayden JA, Des Rosiers P, Harman K, French SD, Curran JA, et al. A Qualitative Study of Doctors of Chiropractic in a Nova Scotian Practice-based Research Network: Barriers and Facilitators to the Screening and Management of Psychosocial Factors for Patients With Low Back Pain. J Manipulative Physiol Ther. 2018 ; 41(1) : 25-33.
  66. Adams J, Peng W, Steel A, Lauche R, Moore C, Amorin-Woods L, et al. A cross-sectional examination of the profile of chiropractors recruited to the Australian Chiropractic Research Network (ACORN): a sustainable resource for future chiropractic research. BMJ Open. 2017 ; 7(9) : e015830.
  67. Evans M, Hawk C, Ndetan H, Rupert R. Patient characteristics, screening use, and health education advice in a chiropractic practice-based research network. Top Integrative Health Care. 2012 ; 3(1) : 3.1-14.
  68. Mastnardo D, Rose JC, Dolata J, Werner JJ. Medical Provider Recommendations to Massage Therapy: a Card Study. Int J Ther Massage Bodywork. 2019 ; 12(3) : 9-15.
  69. Abrams DI, Dolor R, Roberts R, Pechura C, Dusek J, Amoils S, et al. The BraveNet prospective observational study on integrative medicine treatment approaches for pain. BMC Complement Altern Med. 2013 ; 13 : 146.
  70. Dusek JA, Abrams DI, Roberts R, Griffin KH, Trebesch D, Dolor RJ, et al. Patients Receiving Integrative Medicine Effectiveness Registry (PRIMIER) of the BraveNet practice-based research network: study protocol. BMC Complement Altern Med. 2016 ; 16 : 53.
  71. Woggon AJ, Woggon DA. Patient-reported side effects immediately after chiropractic scoliosis treatment: a cross-sectional survey utilizing a practice-based research network. Scoliosis. 2015 ; 10 : 29.
  72. Alcantara J, Ohm J, Kunz D. The Webster technique: results from a practice-based research network study. J Pediatr Matern Fam Health. 2012 ; 2012(1) : 16-21.
  73. Alcantara J, Ohm J, Kunz D. The safety and effectiveness of pediatric chiropractic: a survey of chiropractors and parents in a practice-based research network. Explore. 2009 ; 5(5) : 290-5.
  74. Alcantara J, Ohm J, Alcantara J. The use of PROMIS and the RAND VSQ9 in chiropractic patients receiving care with the Webster Technique. Complement Ther Clin Pract. 2016 ; 23 : 110-6.
  75. Moral-Munoz JA, Cobo MJ, Peis E, Arroyo-Morales M, Herrera-Viedma E. Analyzing the research in Integrative & Complementary Medicine by means of science mapping. Complement Ther Med. 2014 ; 22(2) : 409-18.
  76. Fischer F, Lewith G, Witt CM, Linde K, von Ammon K, Cardini F, et al. A research roadmap for complementary and alternative medicine - what we need to know by 2020. Forsch Komplementarmed. 2014 ; 21(2) : e1-16.
  77. Health Services Research. [cited Oct 2020]. Available from URL:
  78. Taylor JA, Weber W, Standish L, Quinn H, Goesling J, McGann M, et al. Efficacy and safety of echinacea in treating upper respiratory tract infections in children: a randomized controlled trial. JAMA. 2003 ; 290(21) : 2824-30.
  79. Anglemyer A, Horvath HT, Bero L. Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. Cochrane Database Syst Rev. 2014 ; (4) : MR000034.
  80. Sloane PD, Callahan L, Kahwati L, Mitchell CM. Development of a practice-based patient cohort for primary care research. Fam Med. 2006 ; 38(1) : 50-7.
  81. Westfall JM, VanVorst RF, Main DS, Herbert C. Community-based participatory research in practice-based research networks. Ann Fam Med. 2006 ; 4(1) : 8-14.
  82. Curro FA, Thompson VP, Grill A, Craig RG, Botello-Harbaum MB, Matthews AG, et al. An assessment of the perceived benefits and challenges of participating in a practice-based research network. Prim Dent. 2012 ; 1(1) : 50-7.
  83. Steihaug S, Johannessen AK, Ådnanes M, Paulsen B, Mannion R. Challenges in Achieving Collaboration in Clinical Practice: The Case of Norwegian Health Care. Int J Integr Care. 2016 ; 16(3) : 3.
  84. Practitioner Research and Collaboration Initiative. [cited Oct 2020]. Available from URL:
  85. Adams J, Steel A, Moore C, Amorin-Woods L, Sibbritt D. Establishing the ACORN National Practitioner Database: Strategies to Recruit Practitioners to a National Practice-Based Research Network. J Manipulative Physiol Ther. 2016 ; 39(8) : 594-602.
  86. Adams J, Steel A, Chang S, Sibbritt D. Helping address the national research and research capacity needs of Australian chiropractic: introducing the Australian Chiropractic Research Network (ACORN) project. Chiropr Man Therap. 2015 ; 23 : 12.
  87. Alcantara J, Ohm J. Necessity is the Mother of Invention: The Creation and Development of the International Chiropractic Pediatric Association's Practice-Based Research Network. J Pediatr Matern Fam Health. 2015 ; 2015(1) : 1-4.
  88. Steel A, Adams J, Sibbritt D. Developing a multi-modality complementary medicine practice-based research network: The PRACI project. Adv Integr Med. 2014 ; 1(3) : 113-8.
  89. Licciardone JC, Kearns CM. A new triadic paradigm for osteopathic research in real-world settings. J Am Osteopath Assoc. 2012 ; 112(7) : 447-56.
  90. Hawk C, Long CR, Boulanger K. Development of a practice-based research program. J Manipulative Physiol Ther. 1998 ; 21(3) : 149-56.