• Journal of Internet Computing and Services
• /
• v.21 no.6
• /
• pp.81-94
• /
• 2020

This study developed evaluation indicators for the comfort experience of virtual reality (VR) headsets by classifying, defining, and weighting cybersickness-causing factors using the Delphi research method and analytic hierarchical process (AHP) approach. Four surveys were conducted with 20 experts on VR motion sickness. The expert surveys involved the 1) classification and definition of cybersickness-causing dimensions, classification of sub-factors for each dimension, and selection of evaluation indicators, 2) self-reassessment of the results of each step, 3) validity revaluation, and 4) final weighting calculation. Based on the surveys, the evaluation indicators for the comfort experience of VR headsets were classified into eight sub-factors: field of view (FoV)-device FoV, latency-device latency, framerate-device framerate, V-sync-device V-sync, rig-camera angle view, rig-no-parallax point, resolution-device resolution, and resolution-pixels per inch (PPI). A total of six dimensions and eight sub-factors were identified; sub-factor-based evaluation indicators were also developed.

• The Journal of Korean society of community based occupational therapy
• /
• v.10 no.1
• /
• pp.17-30
• /
• 2020

Objective : The purpose of this study is to provide basic data for the development of a instrumental activities of daily living training program called grocery shopping for schizophrenic patients in Delphi. Methods : The final program items and contents were completed through the first and third delphi surveys from August 2018 to March 2019. The expert composition selected 26 occupational therapists related to mental health. Three surveys were conducted and 23 experts participated in the Delphi survey. The second questionnaire, which was created from an open questionnaire, was designed to indicate the degree of importance using the Likert 5-point scale. As a result of the response of the 3rd questionnaire, the level of expert consensus was reconfirmed by analyzing average, standard deviation, and content validity ratio (CVR). Results : Three rounds of Delphi research reveal four categories of questions: grocery shopping views, product purchase strategies, necessary functions, and expert knowledge and experience on how to make purchase decisions. 24 items were selected. Through the 2nd and 3rd Delphi surveys, 4 items that did not meet the criteria of goodness of fit of each item or duplicated the contents were deleted and finally 20 items were extracted. Conclusion : Experts' agreement on grocery shopping technology was drawn from an occupational therapy perspective so that patients with schizophrenia living in the community could recover and participate as a member of society.

• Research in Community and Public Health Nursing
• /
• v.30 no.3
• /
• pp.295-306
• /
• 2019

Purpose: There has been a growing recognition that person-centered care enhances the quality of life of nursing home residents with dementia. This study was conducted to develop a person-centered dementia care online education program for direct care staff in long-term care facilities. Methods: Delphi method with expert group was used to validate contents. We developed 61 draft items based on literature review. Twenty experts participated in consecutive three round surveys including 5-point Likert scale questions and open-ended questions. Based on experts' opinions, the content validity ratio for content validity and the coefficient of variation for stability were calculated. Results: Three-round Delphi surveys and additional feedback from the expert panel established a consensus of core contents: 1) dementia (7 categories), 2) person-centered care (6 categories), 3) communication (8 categories), and 4) behavioral and psychological symptoms of dementia (6 categories). Specific sub-categories in each category were differentiated according to the job qualifications (65 sub-categories for registered nurses, 64 sub-categories for nursing aids, and 41 sub-categories for personal care workers). Conclusion: This delphi study identified person-centered dementia education curricula, in which the person-centered approach should be a key policy priority in Korean long-term care system. Now it is urgently needed to develop education programs utilizing online platforms that enable efficient and continuous learning for long-term care staff, which can contribute to behavior changes in the person-centered dementia care approach and improvement of care quality in long-term care facilities.

• The Journal of Sustainable Design and Educational Environment Research
• /
• v.22 no.2
• /
• pp.1-16
• /
• 2023

This paper reports on three Delphi surveys based on draft evaluation items with the aim of deriving evaluation items prior to developing a BF certification index for school facilities in order to make the index safe and convenient. To this end, problems were formulated using content analysis and follow-up evaluation of existing BF certification indicators. Draft BF certification evaluation items for school facilities were proposed. The adequacy of each evaluation item was verified using a Delphi survey. Experts and working-level groups, such as university professors, architects, public officials, certification agencies, and organizations for disabled persons, provided feedback for all evaluation items for school facility BF, which was incorporated in the final evaluation items. As a result of the Delphi surveys, in addition to the existing 8 evaluation items, a total of 75 evaluation items were proposed as maintenance items, 12 as improvement review items, and 15 as new evaluation items.

• Journal of Korean language education
• /
• v.28 no.4
• /
• pp.149-179
• /
• 2017

The purpose of this study was to establish a Korean reading ability assessment category based on a reading comprehension theory, and to establish an evaluation framework for Korean reading ability after creating the evaluation factors corresponding to each category through expert Delphi survey. The three levels of reading comprehension that were constructed are the following: language knowledge, text comprehension, and interpretation and comprehension of new ideas and application. This study suggested that constructs of Korean reading assessment reflected reading theory. This study has meaningful consequences which suggest verified constructs through Delphi surveys.

• Journal of Digital Convergence
• /
• v.10 no.8
• /
• pp.15-20
• /
• 2012

South Korea is carrying out and expanding smart grid pilot projects to build a framework for a national smart grid and expand overseas markets. It is important to properly evaluate performance for the projects and further develop related businesses in a more desirable direction. This study is to provide evaluation criteria for the performance of smart grid pilot projects and a basis for further continuous development according to the type of projects. Evaluation criteria were selected through reviews of documental materials and expert discussions. The viability of the proposed draft in the situation of South Korea was examined by expert Delphi surveys. The Delphi surveys were conducted twice, and therefrom drawn were 18 evaluation criteria for 6 evaluation categories.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.22 no.4
• /
• pp.8-14
• /
• 2014

The purpose of this research was to develop evaluation conformity to operate courses based on CIPP evaluation model dedicated to approval of training organizations. In order to achieve the goal, the researchers scrutinized related documents and precedent studies, initiated the draft for evaluation conformity to operate courses and secured validity for evaluation conformity initiated through Delphi Method survey. To secure validity for evaluation conformity, the researchers conducted two Delphi Method surveys of an expert panel of 22 professionals from relevant fields including officials from the Ministry of Land, Infrastructure and Transport, researchers from Korea Transportation Safety Authority, instructors from approved training organizations and officials from industries. Through the surveys, the researchers determined 4 evaluation areas, 13 evaluation items and 52 evaluation indexes as the evaluation conformity to operate courses for aircraft maintenance mechanics. On top of that, the researchers established evaluation system in the courses for aviation professionals (aircraft maintenance mechanics), and suggested a follow-up studies regarding managing the quality of education.

• Journal of Engineering Education Research
• /
• v.24 no.3
• /
• pp.32-41
• /
• 2021

The purpose of this study is to develop indicators to establishing the education system, focusing the curriculum in each department of H University for quality management of the curriculum. The indicator was developed based on previous studies and cases studies of other universities, and the validation of them was confirmed by the Delphi survey method. The Delphi surveys were conducted by two times, and 16 and 15 people participated for the first and second survey, respectively. We derived the following major results through developing the indicator. First, in order to conduct an education inspection of major courses, , , , , and are required. Second, the checking factors should be evaluated based on the contents in each stage, and can be regarded as a core activity in the curriculum. Accordingly, the checking factors becomes the basis for the establishment of the indicator to establishing the education system, and the indicator can be an expression method that represents the basis data for determining the factors to be evaluated.

• Journal of Korean Society for Quality Management
• /
• v.46 no.4
• /
• pp.911-922
• /
• 2018

Purpose: This study provides an overview of the Product Liability Act which was revised in 2017 and took effect in 2018. It analyzes the effects of the revised Act on corporate management from internal and external perspectives to present coping strategies so that companies can synthetically respond to such effects. Methods: In order to achieve the purpose of this study, experts like companies, academia, governmental institutions, and consultants were invited, and Delphi techniques were applied to derive means, standard deviations, and Content Validity Ratio. Results: In this study, based on two expert questionnaire surveys, strengths and weaknesses of the internal environment of companies and opportunities and threats of the external environment were derived, followed by provision of S/O, W/O, S/T, and W/T strategies. Conclusion: To fundamentally remove the causes of accidents on their products, the relevant companies should strengthen the activities to increase product safety. They shall cooperate with suppliers to arrange the measures to speedily secure safety of consumers.

• Journal of Korean society of Dental Hygiene
• /
• v.22 no.6
• /
• pp.531-539
• /
• 2022

Objectives: This study aimed to design a CRA questionnaire specifically for Korean children and adolescents based on the results of two Delphi survey completed by dental professionals. Methods: Based on the CAMBRA^® CRA tool, updated in 2019, we constructed a questionnaire on the oral environment and behavior of children and adolescents. Then, the CVR and I-CVI were evaluated using the results of the first and second Delphi surveys involving 20 professionals. Results: After the first Delphi survey, six items were considered invalid because their CVR and I-CVI were below the recommended values of 0.42 and 0.78, respectively. After receiving feedback from the professional panels, nine items were removed. In the second Delphi survey, the questionnaire contained a total of 21 items, all of which showed good CVR and I-CVI. After modifications based on the opinions of professional panels, the questionnaire was finalized to have 21 questions. Conclusions: The finalized questionnaire with 21 items, based on the opinions of professional panels, showed excellent CVR and I-CVI for all the items. Structured programs with updated guidelines must be developed for Korean children and adolescents in further studies.