IEMEK Journal of Embedded Systems and Applications (대한임베디드공학회논문지)

Institute of Embedded Engineering of Korea (대한임베디드공학회)
권호 표지

A Survey of Augmented Reality on Handheld Devices

휴대단말기 기반 증강현실 시스템 연구 및 개발 동향

  • Received : 2010.08.08
  • Accepted : 2010.11.17
  • Published : 2010.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The popularity of Smartphones makes new fields of applications based on location based service easily feasible with a new user interface called augmented reality (AR). It presents a particularly powerful user interface to context-aware computing environments. AR on Smartphones integrates virtual information into a person's physical environment by overlaying information on an image taken through Smartphone's camera and motion sensors. Mobile augmented reality systems provide this service without constraining the individual's whereabouts to a specially equipped area. This work presents an overview of handheld augmented reality focusing on applications with introducing the basic issues of them. For this purpose, an example system, Studierstube ES (embedded system), is cited, which introduces the most significant problems and various methods of solving them through the experience of converting existing PC-based AR system into handheld AR.

Keywords

References

  1. J. Walsh, "Global smartphone sales to hit 2.5bn by 2015 forecasts new market report", PR Log - Global Press Release Distribution, May. 2010.
  2. http://www.layar.com
  3. http://www.wikitude.org
  4. H. Karimi, and A. Hammad, Telegeoinformatics: Location-Based Computing and Services. Taylor & Francis Books, 2004.
  5. I.E. Sutherland, "A head-mounted three dimensional display", Proceedings of Fall Joint Computer Conference, pp. 75-764, 1968.
  6. T.P. Caudell, and D.W. Mizell, "Augmented reality: an application of heads-up display technology to manual manufacturing processes", Proc. of 1992 IEEE Hawaii Int'l Conference on Systems Sciences, pp. 659-669, 1992.
  7. R. Azuma, "A Survey of augmented reality", Presence: Teleoperators and Virtual Environments, pp. 355-385, 1997.
  8. J. Newman, D. Ingram, and A. Hopper, "Augmented reality in a wide area sentient enviroment", Proc. of the 2nd IEEE and ACM Int'l symposium on Augmented Reality (ISAR 2001), pp. 77-86, 2001.
  9. J. Fruend, C. Geiger, M. Grafe and B. Kleinjohann, "The augmented reality personal digital assistant", Proc. of the 2nd Int'l Symposium on Mixed Reality, 2001.
  10. D. Wagner, and d. Schmalstieg, "First steps towards handheld augmented reality", Proc. of the 7th Int'l Conference on Wearable Computers (ISWC), 2003.
  11. N. Ai, Y. Lu and J. Deogun, "The smart phones of tomorrow", ACM SIGBED Review, Vol.5, Issue 1, 2008.
  12. E. Jonietza, "10 Emergin technologies - augumented reality", Technology Review, Mar/Apr. 2007.
  13. O. Rashid, W. Bamford, P. Coulton, R. Edwards and J. Scheible, "PAC-LAN: mixed-reality gaming with RFID enabled mobile phones", ACM Computers in Entertainment, Vol.4, No.4, Oct. 2006.
  14. D. Wagner, and D. Schmalstieg, "ARToolKitPlus for pose tracking on mobile devices", Computer Vision Winter Workshop, Austria, Feb.6-8, 2007.
  15. A. Henrysson, M. Billinghurst and M. Ollila, "Face to face collaborative AR on mobile phones", Proc. of ISMAR (IEEE and ACM Int'l Symposium on Mixed and Augmented Reality), 2005.
  16. A. Olwal, "LightSense: enabling spatially aware handheld interaction devices", Proc. of ISMAR (IEEE and ACM Int'l Symposium on Mixed and Sugmented Reality), pp. 119-122, Oct. 2006.
  17. M. Rauhala, A. Gunnarsson, A. Henrysson and A. Ynnerman, "A Novel interface to sensor networks using handheld augmented reality", ACM Mobile HCI, 2006.
  18. G.W. Fitzmaurice, "Situated information spaces and spatially aware palmtop computers". Communications of the ACM, Special issue on computer augmented environments: back to the real world, Vol.36, Issue.7, pp. 39-49, 1993.
  19. J. Rekimoto, and K. Nagao, "The world through the computer: computer augmented interaction with real world environments", Proc. of the 8th annual ACM symposium on User interface and software technology (UIST '95), pp. 29-36, 1995.
  20. S. Feiner, B. MacIntyre, T. Hollerer and A. Webster, "A touring machine: prototyping 3D mobile augmented reality systems for exploring the urban environment", Proc. of First IEEE Int'l Symposium on Wearable Computers (ISWC'97), pp 74-81, 1997.
  21. M. Billinghurst, H. Kato and I. Poupyrev, "The magicbook-moving seamlessly between reality and virtuality", IEEE Computer Graphics and Applications 2001, Vol.21, Issue3, pp. 6-8, 2001.
  22. J. Gausemeier, J. Frund, C. Matysczok, B. Bruderlin B and D. Beier, "Development of a real time image based object recognition method for mobile AR-devices", In Proc. of the ACM SIGGRAPH AFRIGRAPH 2003: 2nd Int'l Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, Cape Town 2003.
  23. G. Klein, and T. Drummond, "Sensor fusion and occlusion refinement for tablet-based AR", In Proceedings of Third IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, ISMAR'04, Arlington, 2004.
  24. R. Azuma, and J. Leonard, "Performance analysis of an outdoor augmented reality tracking system that relies upon a few mobile beacons", Proceedings of ISMAR 2006 (IEEE and ACM Int'l Symposium on Mixed and Augmented Reality), pp. 119-122, Oct. 2006.
  25. N. Elmqvist, D. Axblom and J. Claesson, "3DVN: a mixed reality platform for mobile navigation assistance", Technical Report No.2006-12, Chalmers Univ. of Technology and Goteborg Univ., 2006.
  26. J. Newman, G. Schall, I. Barakonyi, A. Schurzinger and d. Schmalstieg, "Wide-area tracking tools for augmented reality", Advances in Pervasive Computing 2006, Adjunct Proc. of Pervasive 2006, Dublin, 2006.
  27. G. Reitmayr, and T. Drummond, "Going out: robust model-based tracking for outdoor augmented reality", Proc. of 5th IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, pp. 109-118, 2006.
  28. F. Chehimi, P. Coulton and R. Edwards, "Augmented reality 3D interactive advertisements on smartphones", Sixth Int'l Conf. on the Management of Mobile Business (ICMB 2007), IEEE, 2007.
  29. A. Henrysson, and M. Ollila, "UMAR ubiquitous mobile augmented reality", MUM'2004, ACM, 2004
  30. M. Mohring, C. Lessig and O. Bimber, "Video see-through AR on consumer cell phones", Proc. of the 3th IEEE/ACM int'l Symposium on Mixed and Augmented Reality, pp. 252-253, 2004.
  31. D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond and D. Schmalstieg, "Pose tracking from natural features on mobile phones", Proceedings of the 7th IEEE/ACM Int'l Symposium on Mixed and Augmented Reality'2008, pp. 125-134, 2008.
  32. http://studierstube.icg.tu-graz.ac.at/handheld_ar/stbes.php
  33. D. Wagner, and d. schmalstieg, "Marking augmented reality reactical on mobile phones, prt 2", IEEE Computer Graphics and Applications, Vol.29, No.4, pp. 6-9, Jul. 2009.
  34. D. Wagner, and D. Schmalstieg, "Making augmented reality practical on mobile phones, part 1", IEEE Computer Graphics and Applications, Vol.29, No.3, pp. 12-15. May, 2009.
  35. D. Wagner and D. Schmalstieg, "Experiences with handheld augmented reality", Proc. of the 2007 6th IEEE and ACM Int'l Symposium on Mixed and Augmented Reality, 2007.
  36. D. Drascic, and P. Milgram, "Perceptual issues in augmented reality", Proc. SPIE: Stereoscopic Displays and Virtual Reality Systems III, Vol2653, pp. 123-134, 1996.
  37. F. Zhoul, H. B. Duh and M. Billinghurst, "Trends in augmented reality tracking, interaction and display: a review of the years of ISMAR", Proc. of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, 2008.
  38. Y. Pang, M. L. Yuan, A.Y.C. Nee, S. K. Ong and K. Youcef-Toumi, "A markerless registration method for augmented reality based on affine properties", Prof. of the Seventh Australasian User Interface Conference, Australia, 2006.
  39. T.H. Hollerer, "User interfaces for mobile augmented reality systems", Doctoral thesis, the Graduate School of Arts and Sciences, Columbia Univ, 2004.