International journal of advanced smart convergence

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Study of Facial Expression of Digital Character with Muscle Simulation System

  • He, Yangyang (Dept of Media contents, Graduate School, Dongseo University) ;
  • Choi, Chul-young (Dept of Media contents, Graduate School, Dongseo University)
  • Received : 2019.05.12
  • Accepted : 2019.05.25
  • Published : 2019.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Facial rigging technology has been developing more and more since the 21st century. Facial rigging of various methods is still attempted and a technique of capturing the geometry in real time recently also appears. Currently Modern CG is produced image which is hard to distinguish from actual photograph. However, this kind of technology still requires a lot of equipment and cost. The purpose of this study is to perform facial rigging using muscle simulation instead of using such equipment. Original muscle simulations were made primarily for use in the body of a creature. In this study, however, we use muscle simulations for facial rigging to create a more realistic creature-like effect. To do this, we used Ziva Dynamics' Ziva VFX muscle simulation software. We also develop a method to overcome the disadvantages of muscle simulation. Muscle simulation can not be applied in real time and it takes time to simulate. It also takes a long time to work because the complex muscles must be connected. Our study have solved this problem using blendshape and we want to show you how to apply our method to face rig.

Keywords

OTNBCL_2019_v8n2_162_f0001.png 이미지

Figure 1. Facial motion capture using Medusa[3]

OTNBCL_2019_v8n2_162_f0002.png 이미지

Figure 2. Geometry for muscle simulation, Bone, Muscle, Facia & Skin and attachment

OTNBCL_2019_v8n2_162_f0003.png 이미지

Figure 3. Muscle movement test

OTNBCL_2019_v8n2_162_f0004.png 이미지

Figure 4. Positioning and attachment of Cubes to Muscle

OTNBCL_2019_v8n2_162_f0005.png 이미지

Figure 5. How blend shape works

OTNBCL_2019_v8n2_162_f0006.png 이미지

Figure 6. Result of Facial Muscle simulation and Blend-shape Layer

OTNBCL_2019_v8n2_162_f0007.png 이미지

Figure 7. Comparison of movement of geometry vertex between cluster/blend-shape method and our muscle simulation method

Table 1. Comparision list [12-15]

OTNBCL_2019_v8n2_162_t0001.png 이미지

References

  1. EftychiosSifakis, Igor Neverov, Ronald Fedkiw, "Automatic determination of facial muscle activations from sparse motion capture marker data", ACM SIGGRAPH 2005 Papers, Pages 417-425, July 2005
  2. Matthew Cong, Kiran S. Bhat, Ronald Fedkiw, "Art-Directed Muscle Simulation for High-end Facial Animation", ACM SIGGRAPH Symposium on Computer Animation (2016)
  3. Disney research, https://www.disneyresearch.com/medusa/
  4. Fx guide, face me, https://www.fxguide.com/featured/face-me-part-3-high-end-faces-rd-from-disney-research/
  5. Fx Guide, https://www.fxguide.com/featured/making-thanos-face-the-avengers/
  6. Ziva Dynamics, https://zivadynamics.com/news-media
  7. Parke,"Computer generated animation of faces", Vol.1,pages 451-457.ACM'72.ACM,New York, NY. 1972
  8. Bolun Li, "Creating 3D Tutorial System for Facial Animation: Visualizing Facial Muscle System Based On Facial Action Coding System", A thesis of Drexel University, Master of Science in Digital Media, June. 2014
  9. T. Beeler, B. Bickel, P. Beardsley, R. Sumner, M. Gross, "High-Quality Single-Shot Capture of Facial Geometry", ACM, Transactions on Graphics, vol. 29, no. 3, pp. 40:1-40:9
  10. Chen cao, Derek Bradley, Kun Zhou, Thabo Beeler, "Real-time high-fidelity facial performance capture", ACM Transactions on Graphics (TOG) TOG Homepage,Volume 34 Issue 4, August 2015 Article No. 46
  11. lang Xu, Yuhua Lu, Qian Liu, "Integrating viscoelastic mass spring dampers into position-based dynamics to simulate soft tissue deformation in real time", Royal Society Open Science, vol 5, Issue 2
  12. Veronica Orvalho, Pedro Bastos, Frederic Parke5, Bruno Oliveira, Xenxo Alvarez, "A Facial Rigging Survey", EUROGRAPHICS 2012
  13. Alexandru-Eugen Ichim, LadislavKavan, Merlin Nimier-David, Mark Pauly, "Building and Animating User-Specific Volumetric FaceRigs", Eurographics/ ACM SIGGRAPH Symposium on Computer Animation, 2016
  14. Anna Mempel, "Facial animation using muscles to control the mimic articulation of phonemes" Master of-Science(M.Sc.), 6 December 2012
  15. Masshew Cong, Lana Lan, Ronald Fedkiw, "Muscle Simulation for Facial Animation in Kong: Skull Island",In Proceedings of SIGGRAPH 17 Talks, Los Angeles, CA, USA, July 30 - August 03, 2017
  16. Veronica Costa Teixeira Orvalho, "REUSABLE FACIAL RIGGING AND ANIMATION: CREATE ONCE, USE MANY", University Politecnica de Catalunya, June 2007
  17. Wei Wang, "Muscle-based Facial Animation", Texas A&M University-Corpus Christi, Spring 2010
  18. Hao Li, Thibaut Weise, Mark Pauly, "Example-Based Facial Rigging", ACM Transactions on Graphics,Article No. 32, Volume 29 Issue 4,July 2010