The Individual Discrimination Location Tracking Technology for Multimodal Interaction at the Exhibition

전시 공간에서 다중 인터랙션을 위한 개인식별 위치 측위 기술 연구

  • Received : 2012.03.02
  • Accepted : 2012.03.14
  • Published : 2012.06.30


After the internet era, we are moving to the ubiquitous society. Nowadays the people are interested in the multimodal interaction technology, which enables audience to naturally interact with the computing environment at the exhibitions such as gallery, museum, and park. Also, there are other attempts to provide additional service based on the location information of the audience, or to improve and deploy interaction between subjects and audience by analyzing the using pattern of the people. In order to provide multimodal interaction service to the audience at the exhibition, it is important to distinguish the individuals and trace their location and route. For the location tracking on the outside, GPS is widely used nowadays. GPS is able to get the real time location of the subjects moving fast, so this is one of the important technologies in the field requiring location tracking service. However, as GPS uses the location tracking method using satellites, the service cannot be used on the inside, because it cannot catch the satellite signal. For this reason, the studies about inside location tracking are going on using very short range communication service such as ZigBee, UWB, RFID, as well as using mobile communication network and wireless lan service. However these technologies have shortcomings in that the audience needs to use additional sensor device and it becomes difficult and expensive as the density of the target area gets higher. In addition, the usual exhibition environment has many obstacles for the network, which makes the performance of the system to fall. Above all these things, the biggest problem is that the interaction method using the devices based on the old technologies cannot provide natural service to the users. Plus the system uses sensor recognition method, so multiple users should equip the devices. Therefore, there is the limitation in the number of the users that can use the system simultaneously. In order to make up for these shortcomings, in this study we suggest a technology that gets the exact location information of the users through the location mapping technology using Wi-Fi and 3d camera of the smartphones. We applied the signal amplitude of access point using wireless lan, to develop inside location tracking system with lower price. AP is cheaper than other devices used in other tracking techniques, and by installing the software to the user's mobile device it can be directly used as the tracking system device. We used the Microsoft Kinect sensor for the 3D Camera. Kinect is equippedwith the function discriminating the depth and human information inside the shooting area. Therefore it is appropriate to extract user's body, vector, and acceleration information with low price. We confirm the location of the audience using the cell ID obtained from the Wi-Fi signal. By using smartphones as the basic device for the location service, we solve the problems of additional tagging device and provide environment that multiple users can get the interaction service simultaneously. 3d cameras located at each cell areas get the exact location and status information of the users. The 3d cameras are connected to the Camera Client, calculate the mapping information aligned to each cells, get the exact information of the users, and get the status and pattern information of the audience. The location mapping technique of Camera Client decreases the error rate that occurs on the inside location service, increases accuracy of individual discrimination in the area through the individual discrimination based on body information, and establishes the foundation of the multimodal interaction technology at the exhibition. Calculated data and information enables the users to get the appropriate interaction service through the main server.


Supported by : 한국콘텐츠진흥원


  1. 박옥선, 정광렬, 김성희, "유비쿼터스 컴퓨팅을 위한 위치인식 기술 및 시스템", ETRI 주간기술동향, 1098호, 2003. 6.
  2. 배종환, 조영희, 이정재, 김남진, "개인화 서비스를 위한 모바일 콘텐츠 변환 시스템 연구", 지능정보연구, 17권 2호(2011), 119-128.
  3. 이성호, 김동혁, 송승헌, 성태경, 성세진, "실내 측위용 UWB 시스템 성능평가", 제12차 GNSS Workshop,Jeju, Korea, December 2005.
  4. 이철웅, 안명욱, "유비쿼터스 환경의 핵심-RFID", 한성대학교, 2005.
  5. 조영희, 최이권, "전시 공간에서 지능형 개인화 서비스를 위한 스마트 폰 어플리케이션 설계", 지능정보연구, 17권 2호(2011), 109-117.
  6. Addlesee, M., R. Curwen, S. Hodges, J. Newman, P. Steggles, A. Ward, and A. Hopper, "Implementing a Sentient Computing System", IEEE Computer Magazine, Vol.34, No.8(2001), 50-56.
  7. Bahl, P. and V. Padmanabhan, "RADAR : An In-Building RF-Based User Location and Tracking System", IEEEINFOCOM, Vol.2(2000), Israel, 775-784.
  8. Emiliano, Trevisani and Andrea Vitaletti, "Cell-ID location technique, limits and benefits : Aan experimental study", Proceedings of the Sixth IEEE Workshop on Mobile Computing Systems and Applications(WMCSA 2004)
  9. Jain, HP. and A. Subramanian. "Real-time upper- body human pose estimation using a depth camera", In HP Technical Reports, HPL-2010-190, 2010.
  10. Pahlavan, K., X. Li, and J.-P. Makela, "Indoor Geolocation Science and Technology", IEEE Communications Magazine, (2002), 112-118.
  11. Per Enge, Todd Walter, Sam Pullen, Changdon Kee, Yi-Chung Chao, and Yeou-Jyh Tsai, "Wide Area Augmentation of the Global Positioning System", In Proceeding of the IEEE, 1996.
  12. Priyantha, N., A. Chakraborty, and H. Balakrishnan, "The Cricket Location-Support System", Proc. of the ACM Int'1 Conf. on MobICom, 2000.
  13. Rappaport, T. S., Wireless Communications : Principles and Practice, Prentice Hall, 2nd ed., 2001.
  14. Schiler, J. and A. Voisad, "Location-based services", Morgan Kaumann, 2004
  15. Seongdong. Kim, Seongah. Chin, Moonwon. Choo, "이동 물체의 상호 발생 특징정보를 이용한 동영상에서의 이동물체 추적", 지능정보연구, Vol.9, No.2(2002), 1-13.