Journal of Korean Society of Industrial and Systems Engineering (산업경영시스템학회지)

Society of Korea Industrial and System Engineering (한국산업경영시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Deep Learning-based Approach for Classification of Tribological Time Series Data for Hand Creams

딥러닝을 이용한 핸드크림의 마찰 시계열 데이터 분류

  • Kim, Ji Won (Department of Industrial and Management Engineering, Hannam University) ;
  • Lee, You Min (Department of Industrial and Management Engineering, Hannam University) ;
  • Han, Shawn (Teraleader) ;
  • Kim, Kyeongtaek (Department of Industrial and Management Engineering, Hannam University)
  • Received : 2021.08.15
  • Accepted : 2021.09.15
  • Published : 2021.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The sensory stimulation of a cosmetic product has been deemed to be an ancillary aspect until a decade ago. That point of view has drastically changed on different levels in just a decade. Nowadays cosmetic formulators should unavoidably meet the needs of consumers who want sensory satisfaction, although they do not have much time for new product development. The selection of new products from candidate products largely depend on the panel of human sensory experts. As new product development cycle time decreases, the formulators wanted to find systematic tools that are required to filter candidate products into a short list. Traditional statistical analysis on most physical property tests for the products including tribology tests and rheology tests, do not give any sound foundation for filtering candidate products. In this paper, we suggest a deep learning-based analysis method to identify hand cream products by raw electric signals from tribological sliding test. We compare the result of the deep learning-based method using raw data as input with the results of several machine learning-based analysis methods using manually extracted features as input. Among them, ResNet that is a deep learning model proved to be the best method to identify hand cream used in the test. According to our search in the scientific reported papers, this is the first attempt for predicting test cosmetic product with only raw time-series friction data without any manual feature extraction. Automatic product identification capability without manually extracted features can be used to narrow down the list of the newly developed candidate products.

Keywords

Acknowledgement

This research was supported by R&BD Program through the INNOPOLIS funded by Ministry of Science and ICT (2020-IT-RD-0240).

References

  1. Adejokun, D.A. and Dodou, K., Quantitative Sensory Interpretation of Rheological Parameters of a Cream Formulation, Cosmetics, 2020,Vol. 7, No. 1, https://doi.org/10.3390/cosmetics7010002.
  2. Ahuja, A., Lu, J., and Potanin, A., Rheological Predictions of Sensory Attributes of Lotions, Journal of Texture Studies, 2019, Vol. 50, No. 4, pp. 295-305. https://doi.org/10.1111/jtxs.12401
  3. Alisa, E., Jasmina, H., Ognjenka, R., and Edina, V., Measuring the Feeling: Correlations of Sensorial to Instrumental Analyses of Cosmetic Products, 2017, Proceedings of the International Conference on Medical and Biological Engineering, 2017, pp. 425-428.
  4. Bae, J.-E., Ryoo, J.-Y., and Kang, N.-G., Effects of Linear and Nonlinear Shear Deformation on Measurement for Stickiness of Cosmetics Using Rotational Rheometer, Korea Journal of Cosmetic Science, 2020, Vol. 2, No. 1, pp. 33-46. https://doi.org/10.15230/SCSK.2020.2.1.33
  5. Baki, G., Szoboszlai, M., Liberatore, M.W., and Chandler, M., Application of Check-all-that-apply (CATA) Questions for Sensory Characterization of Cosmetic Emulsions by Untrained Consumers, Journal of Cosmetic Science, 2018, Vol. 69, No. 2, pp. 83-100.
  6. Calixto, L.S., Infante, V.H.P., and Campos, P.M.B.G.M., Design and Characterization of Topical Formulations: Correlations between Instrumental and Sensorial Measurements, AAPS PharmSciTech, 2018, Vol. 19, pp. 1512-1519. https://doi.org/10.1208/s12249-018-0960-0
  7. Cui, Z., Chen, W., and Chen, Y., Multi-Scale Convolutional Neural Networks for Time Series Classification, ArXiv 1603.06995, 2016.
  8. Fawaz, H.I., Forestier, G., Weber, J., Idoumghar, L., and Muller, P.-A., Deep Learning for Time Series Classification: a Review, Data Mining and Knowledge Discovery, 2019, Vol. 33, pp. 917-963. https://doi.org/10.1007/s10618-019-00619-1
  9. Geng, Y. and Luo, X. Cost-Sensitive Convolution based Neural Networks for Imbalanced Time-Series Classification. ArXiv 1801.04396, 2018.
  10. Guest, S., McGlone, F., Hopkinson, A, Schendel, Z. A., Blot, K., and Essick, G., Perceptual and SensoryFunctional Consequences of Skin Care Products, Journal of Cosmetics, Dermatological Sciences and Applications, 2013, Vol. 3, No. 1, pp. 66-78. https://doi.org/10.4236/jcdsa.2013.31A010
  11. He, K., Zhang, X., Ren, S., and Sun, J., Deep Residual Learning for Image Recognition, IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770-778.
  12. Huynh, A., Garcia A.G., Young, L. K., Szoboszlai, M., Liberatore, M. W., and Baki, G., Measurements meet Perceptions: Rheology-Texture-Sensory Relations when using Green, Bio-derived Emollients in Cosmetic Emulsions, International Journal of Cosmetic Science, 2021, Vol. 43, pp. 11-19. https://doi.org/10.1111/ics.12661
  13. Kwon, Y.-H., Kwon, H.-J., Rang, M.-J., and Lee, S.-M., A Study on Correlation between Frictional Coefficients and Subjective Evaluation while Rubbing Cosmetic Product on Skin, Science of Emotion and Sensibility, 2005, Vol. 8, No. 4, pp. 385-391.
  14. Lee, J.H. and Kim, J.J., A Study on the Influence of Package Design of Female Cosmetics on Purchasing Preference, Journal of the Society of Korea Industrial and Systems Engineering, 2004, Vol. 27, No. 3, pp. 52-58.
  15. Mittelman, R., Time-Series Modeling with Undecimated Fully Convolutional Neural Networks. ArXiv 1508.00317, 2015.
  16. Moravkova, T. and Filip, P., Relation between Sensory Analysis and Rheology of Body Lotions, International Journal of Cosmetic Science, 2016, Vol. 38, No. 3, pp. 558-566. https://doi.org/10.1111/ics.12319
  17. Nakano, K., Horiuchi, K., Soneda, T., Kashimoto, A., Tsuchiya, R., Yokoyama, M., A Neural Network Approach to Predict Tactile Comfort of Applying Cosmetic Foundation, Tribology International, 2010, Vol. 43, No. 11, pp. 1978-1990. https://doi.org/10.1016/j.triboint.2010.04.004
  18. Nakano, K., Kobayashi, K., Nakao, K., Tsuchiya, R., Nagai, Y., Tribological Method to Objectify Similarity of Vague Tactile Sensations Experienced during Application of Liquid Cosmetic Foundations, Tribology International, 2013, Vol. 63, pp. 8-13. https://doi.org/10.1016/j.triboint.2012.02.011
  19. Pense-Lheritier, A.-M., Recent Developments in the Sensorial Assessment of Cosmetic Products: a Review, International Journal of Cosmetic Science, 2015, Vol. 37, No. 5, pp. 465-473. https://doi.org/10.1111/ics.12223
  20. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., and Li, F.-F., ImageNet Large Scale Visual Recognition Challenge, International Journal of Computer Vision, 2015, Vol. 115, pp. 211-252. https://doi.org/10.1007/s11263-015-0816-y
  21. Ryoo, J.-Y., Bae, J.-E., and Kang, N.-G., Optimization of In Vivo Stickiness Evaluation for Cosmetic Creams Using Texture Analyzer, Journal of the Society of Cosmetic Scientists of Korea, 2020, Vol. 46, No. 4, pp. 371-382. https://doi.org/10.15230/SCSK.2020.46.4.371
  22. Savary, G., Gilbert, L., Grisel, M., and Picard C., Instrumental and Sensory Methodologies to Characterize the Residual Film of Topical Products Applied to Skin, Skin Research and Technology, 2019, Vol. 25, No. 4, pp. 415-423. https://doi.org/10.1111/srt.12667
  23. Shin, Y.S. and Baek, D.H., A Methodology for Customer Core Requirement Analysis by Using Text Mining : Focused on Chinese Online Cosmetics Market, Journal of Society of Korea Industrial and Systems Engineering, 2021, Vol. 44, No. 2, pp. 66-77. https://doi.org/10.11627/jkise.2021.44.2.066
  24. Vergilio, M. M., de Freitas, A. C. P., da Rocha-Filho, P. A., Comparative Sensory and Instrumental Analyses and Principal Components of Commercial Sunscreens, Journal of Cosmetic Dermatology, 2021, Early View (Online Version of Record before inclusion in an issue) as of 2021/09/17.
  25. Wang, Z., Yan, W., and Oates, T., Time Series Classification from Scratch with Deep Neural Networks : A Strong Baseline, ArXiv: 1611.06455, 2016.
  26. Zhao, B., Lu, H., Chen, S., Liu, J., and Wu, D., Convolutional Neural Networks for Time Series Classification, Journal of Systems Engineering and Electronics, 2017, Vol. 28, No. 1, pp. 162-169. https://doi.org/10.21629/JSEE.2017.01.18
  27. https://www.loreal-finance.com/en/annual-report-2018/cosmetics-market-2-1/ (2021.7.1 access).