Triple-state 보상 함수를 기반으로 한 개선된 DSA 기법

An Improved DSA Strategy based on Triple-States Reward Function

  • 타사미아 (인하대학교 정보통신대학원) ;
  • 구준롱 (인하대학교 정보통신대학원) ;
  • 장성진 (인하대학교 정보통신대학원) ;
  • 김재명 (인하대학교 정보통신대학원)
  • Ahmed, Tasmia (INHA-WiTLAB, Graduate School of IT & Telecommunication) ;
  • Gu, Jun-Rong (INHA-WiTLAB, Graduate School of IT & Telecommunication) ;
  • Jang, Sung-Jeen (INHA-WiTLAB, Graduate School of IT & Telecommunication) ;
  • Kim, Jae-Moung (INHA-WiTLAB, Graduate School of IT & Telecommunication)
  • 투고 : 2010.06.23
  • 심사 : 2010.11.10
  • 발행 : 2010.11.25

초록

본 논문은 보상함수 수정을 통해 보다 완벽한 DSA(Dynamic Spectrum Access)를 수행하는 새로운 방법을 제시하였다. POMDP(Partially Observable Markov Decision Process)는 미래의 스펙트럼 상태를 예측하는데 사용되는 알고리즘으로서, 그 중 보상함수는 스펙트럼을 예측하는데 있어 가장 중요한 부분이다. 그러나 보상함수는 Busy 및 Idle의 두 가지 상태만 갖고 있기 때문에 채널에서 충돌이 발생하게 되면 보상함수는 Busy를 반환함으로써 2차 사용자의 성능을 감소시키게 된다. 따라서 본 논문에서는 기존의 Busy를 Busy 및 Collision 의 두 상태로 구분하였고, 이렇게 추가된 Collision 상태를 통해 2차 사용자의 채널 접근 기회를 보다 향상시킴으로서 데이터 전송율을 증대시킬 수 있도록 하였다. 또한 본 논문은 새로운 알고리즘의 신뢰도 벡터를 수학적으로 분석하였다. 마지막으로 시뮬레이션 결과를 통해 개선된 보상함수의 성능을 검증하고, 이를 통해 새로운 알고리즘이 CR 네트워크에서 2차 사용자의 성능을 향상시킬 수 있음을 보인다.

In this paper, we present a new method to complete Dynamic Spectrum Access by modifying the reward function. Partially Observable Markov Decision Process (POMDP) is an eligible algorithm to predict the upcoming spectrum opportunity. In POMDP, Reward function is the last portion and very important for prediction. However, the Reward function has only two states (Busy and Idle). When collision happens in the channel, reward function indicates busy state which is responsible for the throughput decreasing of secondary user. In this paper, we focus the difference between busy and collision state. We have proposed a new algorithm for reward function that indicates an additional state of collision which brings better communication opportunity for secondary users. Secondary users properly utilize opportunities to access Primary User channels for efficient data transmission with the help of the new reward function. We have derived mathematical belief vector of the new algorithm as well. Simulation results have corroborated the superior performance of improved reward function. The new algorithm has increased the throughput for secondary user in cognitive radio network.

키워드

참고문헌

  1. Qing Zhao, Bhaskar Krishnamachari, "Structure and Optimality of Myopic Sensing for Opportunistic Spectrum Access," Communications, 2007. ICC '07 IEEE International Conference on, pp.6476-6481, June 2007.
  2. Sachin Shetty, Min Song, Chunsheng Xin, E. K. Park, "A Learning-based Multiuser Opportunistic Spectrum Access Approach in Unslotted Primary Networks," INFOCOM 2009, IEEE, pp.2966-2970, April 2009.
  3. Qing. Zhao and B.M. Sadler, "A survey of dynamic spectrum access," IEEE Signal. Processing Magazine, pp.79-89, May 2007.
  4. George E. Monahan, "State of the Art-A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms," MANAGEMENT SCIENCE Vol.28, No.1, pp.1-16, January 1982. https://doi.org/10.1287/mnsc.28.1.1
  5. Yunxia Chen, Qing Zhao, Swami, A., "Joint PHY-MAC design for opportunistic spectrum access in the presence of sensing errors," Information Theory, IEEE Transactions on, Volume 54, Issue 5, pp.2053-2071, May 2008.
  6. Q. Zhao, L. Tong, A. Swami, and Y. Chen "Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: a POMDP framework," IEEE J. Select. Areas Commun., vol.25, no.3, pp.589-600, Apr. 2007.
  7. Jayakrishnan Unnikrishnan, Venugopal V. Veeravalli, "Algorithm for Dynamic Spectrum Access with Learning for Cognitive Radio," Signal Processing, IEEE Transactions on, pp.750-760, Feb. 2009.
  8. Alex Chia-Chun Hsu, David S. L. Weiand C.-C.JayKuo, "A Cognitive MAC Protocol Using Statistical Channel Allocation for Wireless Ad-hoc Networks," Wireless Communications and Networking Conference, pp.105-110, 2007.
  9. Md. Imrul Hassan, Ju Bin Song, Young-Il Kim, "Throughput Capacity of a Wireless Multi-hop Relay Network using Cognitive Radio," Journal of IEEK Volume 44, Issue 5, pp.33-39, May 2007.
  10. I. Hassan, Chang-Bae Rho, Ju Bin Song, "System Throughput of Cognitive Radio Multi-hop Relay Networks," Journal of IEEK Volume 46, Issue 4, pp.29-39, Apr. 2009.