ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Sensorial Information Extraction and Mapping to Generate Temperature Sensory Effects

  • Kim, Sang-Kyun (Department of Computer Engineering, Myongji University) ;
  • Yang, Seung-Jun (Broadcasting & Telecommunications Media Research Laboratory, ETRI) ;
  • Ahn, Chung Hyun (Broadcasting & Telecommunications Media Research Laboratory, ETRI) ;
  • Joo, Yong Soo (Department of Computer Engineering, Myongji University)
  • Received : 2013.09.03
  • Accepted : 2013.12.30
  • Published : 2014.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, a method to extract temperature effect information using the color temperatures of video scenes with mapping to temperature effects is proposed to author temperature effects of multiple sensorial media content automatically. An authoring tool to apply the proposed method is also introduced. The temperature effects generated by the proposed method are evaluated by a subjective test to measure the level of satisfaction. The mean opinion score results show that most of the test video sequences receive an average of approximately four points (in a five-point scale), indicating that test video sequences (with the temperature effects generated by the proposed method) enhance levels of satisfaction.

Keywords

References

  1. R. Kannan, S.R. Balasundaram, and F. Andres, "The Role of Mulsemedia in Digital Content Ecosystem Design," Proc. Int. Conf. Manag. Emergent Digital EcoSyst., 2010, pp. 264-266.
  2. ISO/IEC 23005-2:2011, Information Technology - Media Context and Control - Part 2: Control Information, July 2011.
  3. ISO/IEC 23005-3:2011, Information Technology - Media Context and Control - Part 3: Sensory Information, July 2011.
  4. ISO/IEC 23005-4:2011, Information Technology - Media Context and Control - Part 4: Virtual World Objects and Characteristics, July 2011.
  5. ISO/IEC 23005-5:2011, Information Technology - Media Context and Control - Part 5: Data Formats for Interaction Devices, July 2011.
  6. M. Waltl, C. Timmerer, and H. Hellwagner, "A Test-bed for Quality of Multimedia Experience Evaluation of Sensory Effects," Proc. Int. Workshop Quality Multimedia Exp., San Diego, CA, USA, July 29-31, 2009, pp. 145-150.
  7. B. Choi, E.-S. Lee, and K. Yoon, "Streaming Media with Sensory Effect," Proc. Int. Conf. Inf. Sci. Appl., Jeju Island, Rep. of Korea, Apr. 26-29, 2011, pp. 1-6.
  8. Y.-S. Joo and S.-K. Kim, "Sensory Effect Authoring Tool for Sensible Media," J. Broadcast Eng., vol. 16, no. 5, Sept. 2011, pp. 693-893. https://doi.org/10.5909/JEB.2011.16.5.693
  9. S.-K. Kim, "Authoring Multisensorial Content," Signal Process., Image Commun., vol. 28, issue 2, Feb. 2013, pp. 162-167. https://doi.org/10.1016/j.image.2012.10.011
  10. C. Timmerer et al., "Assessing the Quality of Sensory Experience for Multimedia Presentations," Signal Process., Image Commun., Sept. 2012, pp. 909-916.
  11. S.-K. Kim, Y.-S. Joo, and Y. Lee, "Sensible Media Simulation in an Automobile Application and Human Responses to Sensory Effects," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1001-1010. https://doi.org/10.4218/etrij.13.2013.0038
  12. G. Wyszecki and W.S. Stiles, Color Science, Concepts and Methods, Quantitative Data and Formulae, 2nd ed., New York: John Wiley & Sons, Inc., 1982, pp. 224-225.
  13. ISO/IEC JTC1/SC29/WG11 M7265, "Report of VCE-6 on MPEG-7 Color Temperature Browsing Descriptors," Sydney, Australia, July 2001.
  14. ISO/IEC JTC1/SC29/WG11 M7712, "Report of VCE-6 on MPEG-7 Color Temperature Browsing Descriptors," Pattaya, Thailand, Dec. 2001.
  15. ISO/IEC JTC1/SC29/WG11 M7993, "Report of VCE-6 on MPEG-7 Color Temperature Descriptor for Display Preference," Jeju Island, Rep. of Korea, Mar. 2002.
  16. ITU-T Rec. P.910, Subjective Video Quality Assessment Methods for Multimedia Applications, Apr. 2008.
  17. ITU-T Rec. P.911, Subjective Audiovisual Quality Assessment Methods for Multimedia Applications, Dec. 1998.

Cited by

  1. 감성형용사를 사용한 다양한 향의 프로파일 vol.18, pp.2, 2015, https://doi.org/10.14695/kjsos.2015.18.2.75
  2. Study on 3 DoF Image and Video Stitching Using Sensed Data vol.11, pp.9, 2014, https://doi.org/10.3837/tiis.2017.09.019
  3. 미디어사물인터넷의 국제표준화를 위한 핵심 실험 vol.22, pp.5, 2014, https://doi.org/10.5909/jbe.2017.22.5.579
  4. Beginning of a New Standard: Internet of Media Things vol.11, pp.11, 2014, https://doi.org/10.3837/tiis.2017.11.001
  5. Crowdsourcing authoring of sensory effects on videos vol.78, pp.14, 2014, https://doi.org/10.1007/s11042-019-7312-2
  6. Quality of Experience Experiment Method and Statistical Analysis for 360-degree Video with Sensory Effect vol.25, pp.7, 2014, https://doi.org/10.5909/jbe.2020.25.7.1063
  7. Beyond Multimedia Authoring : On the Need for Mulsemedia Authoring Tools vol.54, pp.7, 2014, https://doi.org/10.1145/3464422