Implementing Responsible Research Assessment in Practice: A Case Study of an Integrated Bibliometric Analysis System

Purpose: This study presents the design and an exploratory pilot evaluation of ORAP (Open Research Analysis Platform), a web-based system for data-driven university research management. Unlike SciVal and InCites, which report metrics separately, ORAP integrates multiple bibliometric indicators into a single, transparently decomposable composite score. Design/methodology/approach: ORAP provides a hierarchical weighted composite score, Citation Gap analysis, a Four-Quadrant Strategic Matrix, and publication-level drilldown. Analyzing institutional SciVal exports, it complements rather than replaces the underlying subscription. Seven users at a Korean national university evaluated it using an instrument adapted from the DeLone and McLean model; results are exploratory. Findings: The study reveals that the overall mean was 4.40 out of 5.0, with usefulness highest (M = 4.71) and use experience lowest (M = 3.57). Originality/Value: The study shows how responsible-assessment principles can be operationalized in a working tool combining composite scoring, adjustable weighting, and publication-level transparency, offering a lower-cost complement to commercial platforms.