• Journal of Preventive Medicine and Public Health
• /
• v.30 no.4 s.59
• /
• pp.719-728
• /
• 1997

To guarantee the inter-reviewer reliability is very important in evaluating the quality of large number of clinical research papers by multiple reviewers. We cannot find reports on statistical methods for evaluating reliability for multiple raters in clinical research field. The purpose of this paper is to introduce the statistical methods focused on kappa statistic and five kinds of loglinear models for, which can be applied when evaluating the reliability of multiple raters. We have applied these methods to the result of a project, in which seven reviewers have evaluated the quality of 33 papers with regard to four aspects of paper contents including study hypothesis, study design, study population, study method, data analysis and interpretation. Among the five loglinear models including Symmetry model, Conditional symmetry model, Quasi-symmetry model, Independence model, and Quasi-independence model, Quasi-symmetry model shows the best model of fitting. And the level of reliability among seven reviewers revealed to be acceptable as meaningful.

• Journal of Intelligence and Information Systems
• /
• v.20 no.1
• /
• pp.49-65
• /
• 2014

Word of Mouth (WOM) is a behavior used by consumers to transfer or communicate their product or service experience to other consumers. Due to the popularity of social media such as Facebook, Twitter, blogs, and online communities, electronic WOM (e-WOM) has become important to the success of products or services. As a result, most enterprises pay close attention to e-WOM for their products or services. This is especially important for movies, as these are experiential products. This paper aims to identify the network factors of an online movie community that impact box office revenue using social network analysis. In addition to traditional WOM factors (volume and valence of WOM), network centrality measures of the online community are included as influential factors in box office revenue. Based on previous research results, we develop five hypotheses on the relationships between potential influential factors (WOM volume, WOM valence, degree centrality, betweenness centrality, closeness centrality) and box office revenue. The first hypothesis is that the accumulated volume of WOM in online product communities is positively related to the total revenue of movies. The second hypothesis is that the accumulated valence of WOM in online product communities is positively related to the total revenue of movies. The third hypothesis is that the average of degree centralities of reviewers in online product communities is positively related to the total revenue of movies. The fourth hypothesis is that the average of betweenness centralities of reviewers in online product communities is positively related to the total revenue of movies. The fifth hypothesis is that the average of betweenness centralities of reviewers in online product communities is positively related to the total revenue of movies. To verify our research model, we collect movie review data from the Internet Movie Database (IMDb), which is a representative online movie community, and movie revenue data from the Box-Office-Mojo website. The movies in this analysis include weekly top-10 movies from September 1, 2012, to September 1, 2013, with in total. We collect movie metadata such as screening periods and user ratings; and community data in IMDb including reviewer identification, review content, review times, responder identification, reply content, reply times, and reply relationships. For the same period, the revenue data from Box-Office-Mojo is collected on a weekly basis. Movie community networks are constructed based on reply relationships between reviewers. Using a social network analysis tool, NodeXL, we calculate the averages of three centralities including degree, betweenness, and closeness centrality for each movie. Correlation analysis of focal variables and the dependent variable (final revenue) shows that three centrality measures are highly correlated, prompting us to perform multiple regressions separately with each centrality measure. Consistent with previous research results, our regression analysis results show that the volume and valence of WOM are positively related to the final box office revenue of movies. Moreover, the averages of betweenness centralities from initial community networks impact the final movie revenues. However, both of the averages of degree centralities and closeness centralities do not influence final movie performance. Based on the regression results, three hypotheses, 1, 2, and 4, are accepted, and two hypotheses, 3 and 5, are rejected. This study tries to link the network structure of e-WOM on online product communities with the product's performance. Based on the analysis of a real online movie community, the results show that online community network structures can work as a predictor of movie performance. The results show that the betweenness centralities of the reviewer community are critical for the prediction of movie performance. However, degree centralities and closeness centralities do not influence movie performance. As future research topics, similar analyses are required for other product categories such as electronic goods and online content to generalize the study results.

• Asian Pacific Journal of Cancer Prevention
• /
• v.15 no.22
• /
• pp.9879-9884
• /
• 2014

Aim: The purpose of the current study was to conduct a systematic review of the published literature to evaluate the diagnostic accuracy of FDG-PET, PTE/CT, MRI and scintigraphy for multiple myeloma related bone disease. Methods: Through a search of PubMed, EMBASE, and the Cochrane Library, two reviewers independently assessed the methodological quality of each study. We estimated pooled sensitivity, specificity, positive and negative likelihood ratios (PLR and NLR), and two sample Z-tests were conducted to evaluate for differences in sensitivity, specificity, area under the curve (AUC), and the $Q^*$ index between any two diagnostic modalities. Results: A total of 17 studies were reviewed. The MRI had a pooled sensitivity of 0.88, specificity of 0.68, AUC of 0.897, and $Q^*$ index of 0.828, whereas for MIBI, the corresponding values were 0.98, 0.90, 0.991, and 0.962, respectively, and for bone scan, they were 066, 0.83, 0.805, and 0.740, respectively. The corresponding values of MIBI were 0.98, 0.90, 0.991, and 0.962, respectively. For PET and PET/CT, the values were 0.91, 0.69, 0.927 and 0.861, respectively. Statistically significant differences were not found in the sensitivity, specificity, AUC, and $Q^*$ index between MRI, scintigraphy, FDG-PET and PET/CT. Conclusions: On the condition that X ray is taken as a reference in our study, we suggested that FDG-PET, PTE/CT, MRI and scintigraphy are all associated with high detection rate of bone disease in patients with MM. Thus, in clinical practice, it is recommended that we could choose these tests according to the condition of the patient.

• Women's Health Nursing
• /
• v.17 no.2
• /
• pp.187-194
• /
• 2011

Purpose: This study investigated the statistical methods and the results had reported correlation/regression analysis in the studies of Korean Journal of Women Health Nursing (KJWHN). Methods: We reviewed 45 studies using correlation/regression analysis for the suitability of the statistical methods and the research purposes, the criteria for analysis of figures, tables and charts had published in the KJWHN from vol 13 (1) in 2007 to vol 15 (4) in 2009. Results: Forty three studies were fitted to their statistical methodology and their research purposes. Eleven studies considered the minimum sample size. Fourteen regression studies used multiple regression and 12 studies used forward method for variable entry. Only one study among the 17 regression studies accomplished scatter plots and residuals examination. Sixteen studies in correlation studies and six studies in regression studies showed some errors in either the title, variables, category of figures, tables and charts. In the regression study, all reported $R^2$ and ${\beta}$ values except one. Conclusion: It was found that there were still statistical errors or articulation errors in the statistical analysis. All reviewers need to be reviewed more closely for detecting errors not only during reviewing process of the manuscript but also periodic publication for the quality of this academic journal.

• Journal of Korean Medical Science
• /
• v.33 no.48
• /
• pp.305.1-305.5
• /
• 2018

Background: In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Methods: Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE). Results: Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016. Conclusion: The KAMJE journal evaluation program successfully contributes improving the quality of the member journals.

• Journal of Dental Anesthesia and Pain Medicine
• /
• v.21 no.6
• /
• pp.507-525
• /
• 2021

Local anesthesia is indispensable in dentistry. Worldwide, millions of local anesthetic injections are administered annually, and are generally considered safe invasive procedures. However, adverse effects are possible, of which dentists should be aware of. This scoping review aimed to provide an extensive overview of the reported literature on the adverse effects of dental local anesthesia. The types of papers, what is reported, and how they are reported were reviewed. Additionally, the incidence and duration of adverse effects and factors influencing their occurrence were also reviewed. An electronic search for relevant articles was performed in PubMed and Embase databases from inception to January 2, 2020. The titles and abstracts were independently screened by two reviewers. The analysis was narrative, and no meta-analysis was performed. This study included 78 articles. Ocular and neurological adverse effects, allergies, hematomas, needle breakage, tissue necrosis, blanching, jaw ankylosis, osteomyelitis, and isolated atrial fibrillation have been described. Multiple adverse effects of dental local anesthesia have been reported in the literature. The results were heterogeneous, and detailed descriptions of the related procedures were lacking. Vital information concerning adverse effects, such as the dosage or type of anesthetic solution, or the type of needle used, was frequently missing. Therefore, high-quality research on this topic is needed. Finally, the adverse effects that are rarely encountered in real-world general practice are overrepresented in the literature.