The Use of Local Outlier Factor(LOF) for Improving Performance of Independent Component Analysis(ICA) based Statistical Process Control(SPC)

LOF를 이용한 ICA 기반 통계적 공정관리의 성능 개선 방법론

  • Received : 2010.11.04
  • Accepted : 2011.02.14
  • Published : 2011.03.31

Abstract

Process monitoring has been emphasized for the monitoring of complex system such as chemical processing industries to achieve the efficiency enhancement, quality management, safety improvement. Recently, ICA (Independent Component Analysis) based MSPC (Multivariate Statistical Process Control) was widely used in process monitoring approaches. Moreover, DICA (Dynamic ICA) has been introduced to consider the system dynamics. However, the existing approaches show the limitation that their performances are strongly dependent on the statistical distributions of control variables. To improve the limitation, we propose a novel approach for process monitoring by integrating DICA and LOF (Local Outlier Factor). In this paper, we aim to improve the fault detection rate with the proposed method. LOF detects local outliers by using density of surrounding space so that its performance is regardless of data distribution. Therefore, the proposed method not only can consider the system dynamics but can also assure robust performance regardless of the statistical distributions of control variables. Comparison experiments were conducted on the widely used benchmark dataset, Tennessee Eastman process (TE process), and showed the improved performance than existing approaches.

Keywords

References

  1. 이재신, 강복영, 강석호, "LOF와 dynamic ICA를 이용한 프로세스 모니터링 방법론", 2010 한국경영과학회 추계학술대회논문집, pp.9-24.
  2. Albazzaz, H. and X. Wang, "Introduction of dynamics to an approach for batch process monitoring using independent component analysis," Chemical Engineering Communications, Vol.194, No.2(2007), pp.218-233. https://doi.org/10.1080/00986440600829739
  3. Albazzaz, H. and X. Wang, "Multivariate statistical batch process monitoring using dynamic independent component analysis," Computer Aided Chemical Engineering, Vol.21, No.(2006), pp.1341-1346.
  4. Breunig, M.M., H.-P. Kriegel, R.T. Ng, and J. Sander, "LOF:identifying density-based local outliers," SIGMOD Rec., Vol.29, No.2(2000), pp.93-104.
  5. Chen, S., W. Wang, and H. van Zuylen, "A comparison of outlier detection algorithms for ITS data," Expert Systems with Applications, Vol.37, No.2(2010), pp.1169-1178. https://doi.org/10.1016/j.eswa.2009.06.008
  6. Cho, H.-W., K.-J. Kim, and M.K. Jeong, "Multivariate statistical diagnosis using triangular representation of fault patterns in principal component space," International Journal of Production Research, Vol.43, No.24(2005), pp.5181-5198. https://doi.org/10.1080/00207540500185141
  7. Downs, J.J. and E.F. Vogel, "A plant-wide industrial process control problem," Computers and Chemical Engineering, Vol.17, No.3 (1993), pp.245-255. https://doi.org/10.1016/0098-1354(93)80237-H
  8. Duan, L., L. Xu, F. Guo, J. Lee, and B. Yan, "A local-density based spatial clustering algorithm with noise," Information Systems, Vol.32, No.7(2007), pp.978-986. https://doi.org/10.1016/j.is.2006.10.006
  9. Ganeriwal, S., L.K. Balzano, and M.B. Srivastava, "Reputation-based framework for high integrity sensor networks," ACM Trans. Sen. Netw., Vol.4, No.3(2008), pp.1-37.
  10. Ge, Z. and Z. Song, "Multimode process monitoring based on Bayesian method," Journal of Chemometrics, Vol.23, No.12(2009), pp.636- 650.
  11. Ge, Z. and Z. Song, "Process Monitoring Based on Independent Component Analysis− Principal Component Analysis (ICA−PCA) and Similarity Factors," Industrial and Engineering Chemistry Research, Vol.46, No.7 (2007), pp.2054-2063. https://doi.org/10.1021/ie061083g
  12. Harris, T.J., C.T. Seppala, and L.D. Desborough, "A review of performance monitoring and assessment techniques for univariate and multivariate control systems," Journal of Process Control, Vol.9, No.1(1999), pp.1-17. https://doi.org/10.1016/S0959-1524(98)00031-6
  13. Hsu, C., M. Chen, and L. Chen, "A novel process monitoring approach with dynamic independent component analysis," Control Engineering Practice, Vol.18, No.3(2010), pp.242- 253. https://doi.org/10.1016/j.conengprac.2009.11.002
  14. Hsu, C.C., L.S. Chen, and C.H. Liu, "A process monitoring scheme based on independent component analysis and adjusted outliers," International Journal of Production Research, Vol.48, No.6(2010), pp.1727-1743. https://doi.org/10.1080/00207540802552683
  15. Hubert, M. and S. Van der Veeken, "Outlier detection for skewed data," Journal of Chemometrics, Vol.22, No.3-4(2008), pp.235-246. https://doi.org/10.1002/cem.1123
  16. Hyvarinen, A. and E. Oja, "Independent component analysis:algorithms and applications," Neural Networks, Vol.13, No.4-5(2000), pp. 411-430. https://doi.org/10.1016/S0893-6080(00)00026-5
  17. Kano, M. and Y. Nakagawa, "Data-based process monitoring, process control, and quality improvement:Recent developments and applications in steel industry," Computers and Chemical Engineering, Vol.32, No.1-2(2008), pp.12-24. https://doi.org/10.1016/j.compchemeng.2007.07.005
  18. Jockenhovel, T., L.T. Biegler, and A. Wachter, "Dynamic optimization of the Tennessee Eastman process using the Opt Control Centre," Computers and Chemical Engineering, Vol.27, No.11(2003), pp.1513-1531. https://doi.org/10.1016/S0098-1354(03)00113-3
  19. Kano, M., S. Tanaka, S. Hasebe, I. Hashimoto, and H. Ohno, "Monitoring independent components for fault detection," AIChE Journal, Vol.49, No.4(2003), pp.969-976. https://doi.org/10.1002/aic.690490414
  20. Kresta, J.V., J.F. Macgregor, and T.E. Marlin, "Multivariate statistical monitoring of process operating performance," The Canadian Journal of Chemical Engineering, Vol.69, No.1(1991), pp.35-47. https://doi.org/10.1002/cjce.5450690105
  21. Lazarevic, A., L. Ertoz, V. Kumar, A. Ozgur, and J. Srivastava, "A comparative study of anomaly detection schemes in network intrusion detection," Proceedings of Third SIAM Conference on Data Mining, (2003), pp.25- 36.
  22. Lee, J.-M., S.J. Qin, and I.-B. Lee, "Fault detection and diagnosis based on modified independent component analysis," AIChE Journal, Vol.52, No.10(2006), pp.3501-3514. https://doi.org/10.1002/aic.10978
  23. Lee, J.-M., C. Yoo, S.W. Choi, P.A. Vanrolleghem, and I.-B. Lee, "Nonlinear process monitoring using kernel principal component analysis," Chemical Engineering Science, Vol.59, No.1(2004), pp.223-234. https://doi.org/10.1016/j.ces.2003.09.012
  24. Lee, J.-M., C. Yoo, and I.-B. Lee, "Statistical monitoring of dynamic processes based on dynamic independent component analysis," Chemical Engineering Science, Vol.59, No.14 (2004), pp.2995-3006. https://doi.org/10.1016/j.ces.2004.04.031
  25. Lee, J.-M., C. Yoo, and I.-B. Lee, "Statistical process monitoring with independent component analysis," Journal of Process Control, Vol.14, No.5(2004), pp.467-485. https://doi.org/10.1016/j.jprocont.2003.09.004
  26. Lee, J., S. Qin, and I. Lee, "Fault detection of non-linear processes using kernel independent component analysis," The Canadian Journal of Chemical Engineering, Vol.85, No.4 (2007), pp.526-536.
  27. Martin, E.B. and A.J. Morris, "Non-parametric confidence bounds for process performance monitoring charts," Journal of Process Control, Vol.6, No.6(1996), pp.349-358. https://doi.org/10.1016/0959-1524(96)00010-8
  28. Monroy, I., R. Benitez, G. Escudero, and M. Graells, "DICA enhanced SVM classification approach to fault diagnosis for chemical processes," Computer Aided Chemical Engineering, Vol.26, No.(2009), pp.267-272.
  29. Pokrajac, D., A. Lazarevic, and L.J. Latecki, "Incremental local outlier detection for data streams," In Proceedings of IEEE Symposium on Computational Intelligence and Data Mining, Vol.769(2007), pp.504-515.
  30. Venkatasubramanian, V., R. Rengaswamy, K. Yin, and S.N. Kavuri, "A review of process fault detection and diagnosis:Part I:Quantitative model-based methods," Computers and Chemical Engineering, Vol.27, No.3(2003), pp.293-311. https://doi.org/10.1016/S0098-1354(02)00160-6
  31. Wang, H., T.-Y. Chai, J.-L. Ding, M. Brown, "Data Driven Fault Diagnosis and Fault Tolerant Control:Some Advances and Possible New Directions," Acta Automatica Sinica, Vol.35, No.6(2009), pp.739-747. https://doi.org/10.3724/SP.J.1004.2009.00739
  32. Wang, K. and F. Tsung, "Monitoring feedback- controlled processes using adaptive T2 schemes," International Journal of Production Research, Vol.45, No.23(2007), pp.5601-5619. https://doi.org/10.1080/00207540701325488
  33. Yu, J., "Hidden Markov models combining local and global information for nonlinear and multimodal process monitoring," Journal of Process Control, Vol.20, No.3(2010), pp. 344-359. https://doi.org/10.1016/j.jprocont.2009.12.002
  34. Zhang, Y. and J. Jiang, "Bibliographical review on reconfigurable fault-tolerant control systems," Annual Reviews in Control, Vol. 32, No.2(2008), pp.229-252. https://doi.org/10.1016/j.arcontrol.2008.03.008
  35. http://brahms.scs.uiuc.edu.