Nuclear Engineering and Technology

Korean Nuclear Society (한국원자력학회)
권호 표지
DOI QR코드

DOI QR Code

SACADA and HuREX: Part 1. the use of SACADA and HuREX systems to collect human reliability data

  • Received : 2021.04.12
  • Accepted : 2021.10.24
  • Published : 2022.05.25
Download PDF
⟨ Previous Next ⟩

Abstract

As a part of probabilistic risk (or safety) assessment (PRA or PSA) of nuclear power plants (NPPs), the primary role of human reliability analysis (HRA) is to provide credible estimations of the human error probabilities (HEPs) of safety-critical tasks. Accordingly, HRA community has emphasized the accumulation of HRA data to support HRA practitioners for many decades. To this end, it is critical to resolve practical problems including (but not limited to): (1) how to collect HRA data from available information sources, and (2) how to inform HRA practitioners with the collected HRA data. In this regard, the U.S. Nuclear Regulatory Commission (NRC) and Korea Atomic Energy Research Institute (KAERI) independently initiated two large projects to accumulate HRA data by using full-scale simulators (i.e., simulator data). In terms of resolving the first practical problem, the NRC and KAERI developed two dedicated HRA data collection systems, SACADA (Scenario Authoring, Characterization, And Debriefing Application) and HuREX (Human Reliability data EXtraction), respectively. In addition, to inform HRA practitioners, the NRC and KAERI proposed several ideas to extract useful information from simulator data. This paper is the first of two papers to discuss the technical underpinnings of the development of the SACADA and HuREX systems.

Keywords

Acknowledgement

This work was supported by a grant from the Nuclear Research & Development Program of the National Research Foundation of Korea, funded by the Korean government, Ministry of Science, ICT & Future Planning (grant number 2017M2A8A4015291 and 2019M2C9A1055906).

References

  1. A.J. Spurgin, P. Moieni, C.D. Gaddy, G.W. Parry, D.D. Orvis, J.P. Spurgin, V. Joksimovich, D.P. Gaver, G.W. Hannaman, EPRI NP-6937, Operator Reliability Experiments Using Power Plant Simulators Volume 1: Executive Summary, vol. 1, Electric Power Research Institute, 1990, https://www.epri.com/research/products/NP-6937-V1.
  2. A.J. Spurgin, P. Moieni, C.D. Gaddy, G.W. Parry, D.D. Orvis, J.P. Spurgin, V. Joksimovich, D.P. Gaver, G.W. Hannaman, Appende\\ixes, Operator Reliability Experiments Using Power Plant Simulators Volume 3, vol. 3, Electric Power Research Institute, 1990. EPRI NP-6937, https://www.epri.com/research/products/NP-6937-V1.
  3. A.J. Spurgin, P. Moieni, C.D. Gaddy, G.W. Parry, D.D. Orvis, J.P. Spurgin, V. Joksimovich, D.P. Gaver, G.W. Hannaman, Technical Report, Operator Reliability Experiments Using Power Plant Simulators Volume 2, vol. 2, Electric Power Research Institute, 1990. EPRI NP-6937, https://www.epri.com/research/products/NP-6937-V1.
  4. A.J. Spurgin, P. Moieni, V. Joksimovich, C.J. Luna, G. Parry, B.O.Y. Lydell, A Human Reliability Analysis Approach Using Measurements for Individual Plant Examination, NP-6560-L, Electric Power Research Institute, 1989, https://www.epri.com/research/products/NP-6560-L.
  5. C. Bieder, P. Le-Bot, E. Desmares, J.-L. Bonnet, F. Cara, MERMOS : EDF's new advanced HRA method, in: A. Mosleh, R.A. Bari (Eds.), IAPSAM 4, Springer, New York City, 1998, pp. 129-134.
  6. P. Meyer, P. Le Bot, H. Pesme, MERMOS: an extended second generation HRA method, IEEE.2007/08//, http://ieeexplore.ieee.org/document/4413219/, 2007.
  7. W. Jung, J. Park, Y. Kim, S.Y. Choi, S. Kim, HuREX - a framework of HRA data collection from simulators in nuclear power plants, Reliab. Eng. Syst. Saf. 194 (2020) 106235. http://www.sciencedirect.com/science/article/pii/S0951832017309857. https://doi.org/10.1016/j.ress.2018.07.036
  8. J. Park, W. Jung, OPERA-a human performance database under simulated emergencies of nuclear power plants, Reliab. Eng. Syst. Saf. 92 (4) (2007) 503-519. https://www.sciencedirect.com/science/article/pii/S0951832006000329. https://doi.org/10.1016/j.ress.2006.01.007
  9. J. Park, W. Jung, J. Kim, J. Ha, Analysis of Human Performance Observed under Simulated Emergencies of Nuclear Power Plants, Korea Atomic Energy Research Institute, 2005. KAERI/TR-2895/2005.
  10. Y. Kim, J. Kim, J. Park, S.Y. Choi, S. Kim, W. Jung, H.E. Kim, S.K. Shin, An HRA Method for Digital Main Control Rooms - Part I: Estimating the Failure Probability of Timely Performance, Korea Atomic Energy Research Institute, 2019. KAERI/TR-7607/2019.
  11. J. Kim, S.J. Lee, HuRECA: human reliability evaluator for computer-based control room Actions, in: The Joint WGRISK/WGHOF Project, 3rd HRA Task Meeting, 2012. OECD/NEA Headquarters, 6-9 Nov., 2012.
  12. J. Kim, S.J. Lee, S. Jang, HuRECA: the Human Reliability Analysis Method for Computer-Based Advanced Control Rooms, Korea Atomic Energy Research Institute, 2011. KAERI/TR-4385.
  13. Y.J. Chang, D. Bley, L. Criscione, B. Kirwan, A. Mosleh, T. Madary, R. Nowell, R. Richards, E.M. Roth, S. Sieben, A. Zoulis, The SACADA database for human reliability and human performance, Reliab. Eng. Syst. Saf. 125 (2014) 117-133, https://doi.org/10.1016/j.ress.2013.07.014.
  14. U. S. Nuclear Regulatory Commission, Human reliability analysis data - SACADA data. https://www.nrc.gov/data/, 2019 (Human Reliability Analysis).
  15. J. Xing, Y.J. Chang, J. DeJesus, Integrated human event analysis system for event and condition assessment (IDHEAS-ECA), RIL-2020-02, U.S. Nuclear Regulatory Commission, ADAMS Accession No. ML20016A481, https://www.nrc.gov/docs/ML2001/ML20016A481.pdf, 2020.
  16. J. Xing, Y.J. Chang, J. DeJesus, The General Methodology of an Integrated Human Event Analysis System (IDHEAS-G), NUREG-2198 U.S. Nuclear Regulatory Commission, 2021. ADAMS Accession No. ML21127A272.
  17. K. Jan, R. Dolezal, HRA data collection projects in Czech Republic, in: HRA Data Workshop, U.S. Nuclear Regulatory Commission, Rockville Maryland, 2020. ADAMS Accession No. ML20083J308.
  18. J. Forester, H. Liao, V.N. Dang, A. Bye, E. Lois, M. Presley, J. Marble, R. Nowell, H. Broberg, M. Hildebrandt, B. Halbert, T. Morgan, The U.S. HRA empirical study - assessment of HRA method predictions against operating crew performance on a U.S. Nuclear power plant simulator, NUREG-2156 (ADAMS Accession No. ML16179A124), U.S. Nuclear Regulatory Commission, https://www.nrc.gov/docs/ML1617/ML16179A124.pdf, 2016.
  19. A. Bye, E. Lois, V.N. Dang, G. Parry, J. Forester, S. Massaiu, R. Boring, P.O. Braarud, H. Broberg, J. Julius, I. Mannisto, P. Nelson, The International HRA Empirical Study - Phase 2 Report Results from Comparing HRA Methods Predictions to HAMMLAB Simulator on SGTR Scenarios - Appendix A, OECD Halden Reactor Project, 2010. HWR-915, APP A.
  20. V.N. Dang, J. Forester, R. Boring, H. Broberg, S. Massaiu, J. Julius, I. Mannisto, H. Liao, P. Nelson, E. Lois, A. Bye, NUREG/IA-0216, International HRA Empirical Study - Phase 3 Report: Results from Comparing HRA Methods Predictions to HAMMLAB Simulator Data on LOFW Scenarios, vol. 3, U.S. Nuclear Regulatory Commission, 2014 (ADAMS Accession No. ML14358A254), https://www.nrc.gov/docs/ML1435/ML14358A254.pdf.
  21. J. Forester, V.N. Dang, A. Bye, E. Lois, S. Massaiu, H. Broberg, P.O. Braarud, R. Boring, I. Mannisto, H. Liao, J. Julius, G. Parry, P. Nelson, The International HRA Empirical Study -Final Report - Lessons Learned from Comparing HRA Methods Predictions to HAMMLAB Simulator Data, 2012. HPR-373.
  22. J. Forester, V.N. Dang, A. Bye, E. Lois, S. Massaiu, H. Broberg, P.O. Braarud, R. Boring, I. Mannisto, H. Liao, J. Julius, G. Parry, P. Nelson, The International HRA Empirical Study: Lessons Learned from Comparing HRA Methods Predictions to HAMMLAB Simulator Data, 2014. NUREG-2127 (ADAMS Accession No. ML14227A197), U.S. Nuclear Regulatory Commission, https://www.nrc.gov/docs/ML1422/ML14227A197.pdf.
  23. E. Lois, V.N. Dang, J. Forester, H. Broberg, S. Massaiu, M. Hildebrandt, P.O. Braarud, G. Parry, J. Julius, R. Boring, I. Mannisto, A. Bye, NUREG/IA-0216, International HRA Empirical Study - Phase 1 Report: Description of Overall Approach and Pilot Phase Results from Comparing HRA Methods to Simulator Performance Data, vol. 1, U.S. Nuclear Regulatory Commission, 2009 (ADAMS Accession No. ML093380283), https://www.nrc.gov/docs/ML0933/ML093380283.pdf.
  24. A. Poucet, Human Factors Reliability Benchmark Exercise (HF-RBE) Synthesis Report, Commission of the European Communities, 1989.
  25. Nuclear Energy Agency, Simulator Studies for HRA Purposes - Workshop Proceedings, 1. 2009, NEA/CSNI/R, Budapest, Hungry, 2012. November 4-6, 2009.
  26. W. Jung, HuREX-Human reliability data extraction - a framework for simulator data collection and analysis to generate human error probability, in: HRA Data Workshop, U.S. Nuclear Regulatory Commission, Rockville, Maryland, 2018. March 15-16, 2018.ADAMS Accession No. ML18079A156.
  27. K. Jan, R. Dolezal, Roundtable discussion - UJV, in: HRA Data Workshop, U.S. Nuclear Regulatory Commission, Rockville Maryland, 2020. ADAMS Accession No. ML20083J326.
  28. A. Bye, E. Lois, V.N. Dang, G. Parry, J. Forester, S. Massaiu, R. Boring, P.O. Braarud, H. Broberg, J. Julius, I. Mannisto, P. Nelson, NUREG/IA-0216, International HRA Empirical Study - Phase 2 Report: Results from Comparing HRA Method Predictions to Simulator Data from SGTR Scenarios, vol. 2, U.S. Nuclear Regulatory Commission, 2011. ADAMS Accession No. ML11250A010, https://www.nrc.gov/docs/ML1125/ML11250A010.pdf.
  29. A. Wright, A. Bye, Human Reliability Data for Central Control of Modern Power Stations, CRA-IFE-ENGL, Report No. 1, Issue 1, Corporate Risk Associates Limited (CRA) and the Institute of Energy Technology (IFE): EDF Energy Generation Limited (ENGL), 2019.
  30. Collecting HRA Data Workshop, Probabilistic Safety Assessment and Management (PSAM 14), UCLA Meyer & Renee Luskin Conference Center, Los Angeles, CA, 2018. September 16-21, 2018, http://www.iapsam.org/psam14/Program-Tech-workshops-4.html.
  31. U.S. Nuclear Regulatory Commission, HRA Data Workshop, 2018. Rockville, Maryland, the NRC Headquarters, March 15-16, 2018.ADAMS Accession No. ML18079A156.
  32. U.S. Nuclear Regulatory Commission, HRA Data Workshop, 2019. Rockville, Maryland, the NRC Headquarters, March 14-15, 2019.ADAMS Accession No. ML19092A461.
  33. U.S. Nuclear Regulatory Commission, HRA Data Workshop, 2020. Rockville, Maryland, the NRC Headquarters, March 12-13, 2020.ADAMS Accession No. ML20083J304.
  34. Wednesday, February 4, 2009 U.S. Nuclear Regulatory Commission, Staff requirements - briefing on risk-informed, performance-based regulation, 1:30 p.m., SRM M090204B, in: Commissioners' Conference Room, One White Flint North, Rockville, Maryland (Open to Public Attendance), U.S. Nuclear Regulatory Commission, 2009. ADAMS Accession No. ML090490812, https://www.nrc.gov/reading-rm/doc-collections/commission/srm/meet/2009/m20090204b.pdf.
  35. J. Park, Y. Kim, W. Jung, Application of the HuREX Framework for Calculating Empirical Human Error Probabilities from the Operation Experience of Domestic Nuclear Power Plants - Preliminary Results, Korea Atomic Energy Research Institute, 2016. KAERI/TR-6474.
  36. J. Reason, Human Error, Cambridge University Press, 1990, 0-521-31419-4.
  37. J.K. Park, W. Jung, A Framework to Estimate HEPs from the Full-Scope Simulators of NPPs: Unsafe Act Definition, Identification and Quantification, Korea Atomic Energy Research Institute, 2016. KAERI/TR-6401/2016.
  38. J. Park, Y. Kim, S.Y. Choi, W. Jung, H.E. Kim, Review on the Applicability and Appropriateness of HRA Data Extraction Based on the HuREX Framework, Korea Atomic Energy Research Institute, 2020. KAERI/TR-8038.
  39. Y. Kim, J. Park, Incorporating prior knowledge with simulation data to estimate PSF multipliers using Bayesian logistic regression, Reliab. Eng. Syst. Saf. 189 (2019) 210-217. http://www.sciencedirect.com/science/article/pii/S0951832018314893. https://doi.org/10.1016/j.ress.2019.04.022
  40. S. Kim, Y. Kim, S.Y. Choi, W. Jung, J. Park, Design and implementation of HuREX analysis supporting interface for HRA data extraction, Nucl. Technol. 202 (2-3) (2018) 259-277, https://doi.org/10.1080/00295450.2017.1409053.
  41. Y. Kim, Considerations for generating meaningful HRA data: lessons learned from HuREX data collection, Nucl. Eng. Technol. 52 (8) (2020) 1697-1705. http://www.sciencedirect.com/science/article/pii/S173857331930854X. https://doi.org/10.1016/j.net.2020.01.034
  42. M.A. Azarm, I.S. Kim, C. Marks, F. Azarm, Proposed methods for using SACADA DATA for empirical HRA estimation, March 15-16, 2018, in: HRA Data Workshop, the NRC Headquarters, Maryland: U.S. Nuclear Regulatory Commission, Rockville, 2018. ADAMS Accession No. ML18079A161.
  43. S. Fitch, P.F. Nelson, C.R. Grantom, A method to use SACADA data for estimating human error probabilities of human failure events, March 15-16, 2018, in: HRA Data Workshop, the NRC Headquarters, 2018. Rockville, Maryland.ADAMS Accession No. ML18079A160.
  44. K.M. Groth, J.D. Tedeschi, R. Moradi, Transforming HRA using SACADA data, Bayesian methods, and DBNs, March 15-16, 2018, in: HRA Data Workshop, the NRC Headquarters, 2018. Rockville, Maryland.ADAMS Accession No. ML18079A162.