DOI QR코드

DOI QR Code

Information Presentation Strategies for Recommender-Chatbots

  • Juyoung Kim (Department of Business Administration, School of Business, Sogang University) ;
  • Jaeyoung Jang (Department of Business Administration, School of Business, Sogang University)
  • Received : 2026.01.31
  • Accepted : 2026.05.21
  • Published : 2026.06.30

Abstract

This study examines how information presentation strategies-specifically online review provision and price framing-affect user experience and reuse intention in an LLM-based hotel recommender chatbot. To investigate this, we developed a hybrid chatbot integrating a large language model (LLM), Text-to-SQL, and Retrieval-Augmented Generation (RAG), and conducted a 2 × 2 between-subjects experiment based on real user interactions. Data were collected from 160 participants who interacted with the chatbot and subsequently completed a survey. The results indicate that both online review provision and downward price framing significantly enhance perceived recommender chatbot quality, which subsequently increases user satisfaction and reuse intention, whereas their interaction effect is not significant. In addition, exploratory factor analysis revealed that the multidimensional structure of chatbot quality converged into a single higher-order factor. Mediation analysis further showed that the effects of information presentation strategies on behavioral outcomes were mediated by perceived chatbot quality and satisfaction. These findings suggest that, in conversational recommender environments, information presentation strategies influence user behavior primarily through holistic quality evaluations rather than through direct effects on satisfaction.

Keywords

References

  1. Ashfaq, M., Yun, J., Yu, S., and Loureiro, S. M. C. (2020). I, chatbot: Modeling the determinants of users' satisfaction and continuance intention of AI-powered service agents. Telematics and Informatics, 54, 101473. https://doi.org/10.1016/j.tele.2020.101473
  2. Benke, I., Gnewuch, U., and Maedche, A. (2022). Understanding the impact of control levels over emotion-aware chatbots. Computers in Human Behavior, 129, 107122. https://doi.org/10.1016/j.chb.2021.107122
  3. Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation-confirmation model. MIS Quarterly, 25(3), 351-370. https://doi.org/10.2307/3250921
  4. Bian, Z., and Che, C. (2025). How AI overview of customer reviews influences consumer perceptions in e-commerce. Journal of Theoretical and Applied Electronic Commerce Research, 20(4), 315. https://doi.org/10.3390/jtaer20040315
  5. Brady, M. K., and Cronin, J. J. (2001). Some new thoughts on conceptualizing perceived service quality: A hierarchical approach. Journal of Marketing, 65(3), 34-49. https://doi.org/10.1509/jmkg.65.3.34.18334
  6. Brandtzaeg, P. B., and Følstad, A. (2017). Why people use chatbots. In I. Kompatsiaris, J. Cave, A. Satsiou, G. Carle, A. Passani, E. Kontopoulos, S. Diplaris, and D. McMillan (Eds.), Internet Science: INSCI 2017 (pp. 377-392). Springer. https://doi.org/10.1007/978-3-319-70284-1_30
  7. Cantallops, A. S., and Salvi, F. (2014). New consumer behavior: A review of research on eWOM and hotels. International Journal of Hospitality Management, 36, 41-51. https://doi.org/10.1016/j.ijhm.2013.08.007
  8. Chaves, A. P., and Gerosa, M. A. (2021). How should my chatbot interact? International Journal of Human-Computer Interaction, 37(8), 729-758. https://doi.org/10.1080/10447318.2020.1841438
  9. Chen, J., Lin, H., Han, X., and Sun, L. (2024). Benchmarking large language models in retrieval-augmented generation. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16), 17754-17762. https://doi.org/10.1609/aaai.v38i16.29728
  10. Chen, Q., Gong, Y., Lu, Y., and Tang, J. (2022). Classifying and measuring the service quality of AI chatbot in frontline service. Journal of Business Research, 145, 552-568. https://doi.org/10.1016/j.jbusres.2022.02.088
  11. Choi, J., Park, J., and Suh, J. (2023). Evaluating the current state of ChatGPT and its disruptive potential: An empirical study of Korean users. Asia Pacific Journal of Information Systems, 33(4), 1058-1092. https://doi.org/10.14329/apjis.2023.33.4.1058
  12. Churchill, G. A., and Surprenant, C. (1982). An investigation into the determinants of customer satisfaction. Journal of Marketing Research, 19(4), 491-504. https://doi.org/10.1177/002224378201900410
  13. Dabholkar, P. A., Shepherd, C. D., and Thorpe, D. I. (2000). A comprehensive framework for service quality. Journal of Retailing, 76(2), 139-173. https://doi.org/10.1016/S0022-4359(00)00029-4
  14. Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of IT. MIS Quarterly, 13(3), 319-340. https://doi.org/10.2307/249008
  15. Degachi, C., Tielman, M. L., and Al Owayyed, M. (2023). Trust and perceived control in burnout support chatbots. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Article 295). https://doi.org/10.1145/3544549.3585780
  16. DeLone, W. H., and McLean, E. R. (2003). The DeLone and McLean model: A ten-year update. Journal of Management Information Systems, 19(4), 9-30. https://doi.org/10.1080/07421222.2003.11045748
  17. DeLone, W. H., and McLean, E. R. (2016). Information systems success measurement. Foundations and Trends in Information Systems, 2(1), 1-116. https://doi.org/10.1561/2900000005
  18. Ding, Y., and Najaf, M. (2024). Interactivity, humanness, and trust: A psychological approach to AI chatbot adoption in e-commerce. BMC Psychology, 12, 595. https://doi.org/10.1186/s40359-024-02083-z
  19. Fabian, V., and Bahri, R. S. (2025). The influence of online customer review, rating, service, and price on repurchase intention at Shopee. International Research Journal of Economics and Management Studies, 4(2), 131-137. https://doi.org/10.56472/25835238/IRJEMS-V4I2P114
  20. Feine, J., Gnewuch, U., Morana, S., and Maedche, A. (2019). A taxonomy of social cues for conversational agents. International Journal of Human-Computer Studies, 132, 138-161. https://doi.org/10.1016/j.ijhcs.2019.07.009
  21. Gao, C., Lei, W., He, X., De Rijke, M., and Chua, T. S. (2021). Advances and challenges in conversational recommender systems: A survey. AI Open, 2, 100-126. https://doi.org/10.1016/j.aiopen.2021.06.002
  22. Hassenzahl, M., Diefenbach, S., and Göritz, A. (2010). Needs, affect, and interactive products - Facets of user experience. Interacting with Computers, 22(5), 353-362. https://doi.org/10.1016/j.intcom.2010.04.002
  23. Hayes, A. F. (2017). Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach. Guilford Press.
  24. Hidayat-ur-Rehman, I. (2024). Examining AI competence, chatbot use and perceived autonomy as drivers of students' engagement in informal digital learning . Journal of Research in Innovative Teaching & Learning, 17(2), 196-212. https://doi.org/10.1108/JRIT-05-2024-0136
  25. Hornbæk, K., and Hertzum, M. (2017). Technology acceptance and User Experience: A review of the experiential component in HCI. ACM Transactions on Computer-Human Interaction, 24(5), Article 33. https://doi.org/10.1145/3127358
  26. Hsu, C. L., and Lin, J. C. C. (2023). User satisfaction and loyalty of customer service chatbots. Journal of Retailing and Consumer Services, 71, 103211. https://doi.org/10.1016/j.jretconser.2022.103211
  27. Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., and Liu, T. (2025). A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems, 43(2), Article 42. https://doi.org/10.1145/3703155
  28. Jannach, D., Manzoor, A., Cai, W., and Chen, L. (2021). A survey on conversational recommender systems. ACM Computing Surveys, 54(5), Article 105. https://doi.org/10.1145/3453154
  29. Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., and Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), Article 248. https://doi.org/10.1145/3571730
  30. Kim, M. K., Jhee, S. Y., and Han, S. L. (2025). The impact of ChatGPT's quality factors on perceived usefulness, perceived enjoyment, and continuous usage intention using the IS success model. Asia Marketing Journal, 26(4), 243-254. https://doi.org/10.53728/2765-6500.1641
  31. Law, E. L. C., Roto, V., Hassenzahl, M., Vermeeren, A. P., and Kort, J. (2009). Understanding, scoping and defining user experience: A survey approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 719-728). https://doi.org/10.1145/1518701.1518813
  32. Li, Z., Nie, J., Zhang, X., Shi, Z. M., and Li, K. (2025). How Do AI-Generated Summaries Affect Consumer Decision-Making? Field and Experimental Evidence from Digital Deal Platforms. Field and Experimental Evidence from Digital Deal Platforms (July 18, 2025).
  33. Manigandan, L., and Alur, S. (2024). An in-depth investigation into the influence of chatbot usability and age on continuous intention to use: A comprehensive study. Asia Pacific Journal of Information Systems, 34(1), 351-371. https://doi.org/10.14329/apjis.2024.34.1.351
  34. Mazumdar, T., Raj, S. P., and Sinha, I. (2005). Reference price research: Review and propositions. Journal of Marketing, 69(4), 84-102. https://doi.org/10.1509/jmkg.2005.69.4.84
  35. Møller, C. G., Ang, K. E., de Lourdes Bongiovanni, M., Khalid, M. S., and Wu, J. (2024). Metrics of success: Evaluating user satisfaction in AI chatbots. In Proceedings of the 2024 8th International Conference on Advances in Artificial Intelligence (pp. 168-173). https://doi.org/10.1145/3704137.3704182
  36. Nelson, P. (1970). Information and consumer behavior. Journal of Political Economy, 78(2), 311-329. https://doi.org/10.1086/259630
  37. Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books.
  38. Oliver, R. L. (1980). A cognitive model of the antecedents and consequences of satisfaction decisions. Journal of Marketing Research, 17(4), 460-469. https://doi.org/10.1177/002224378001700405
  39. Park, S., Xie, M., and Xie, J. (2023). Frontiers: Framing price increase as discount: A new manipulation of reference price. Marketing Science, 42(1), 37-47. https://doi.org/10.1287/mksc.2022.1402
  40. Purnomo, K. D., and Diharto, A. K. (2021). The effects of online customer reviews and customer experiences on reuse intention of mobile food ordering application (MFOA). Relevance: Journal of Management and Business, 4(2), 139-155. https://doi.org/10.22515/relevance.v4i2.4418
  41. Rese, A., Ganster, L., and Baier, D. (2020). Chatbots in retailers' communication: How to measure their acceptance? Journal of Retailing and Consumer Services, 56, 102176. https://doi.org/10.1016/j.jretconser.2020.102176
  42. Seraquive, J. E. G., Álvarez-Muñoz, P., Palacios-Zamora, K., Gamboa, D. A. P., and Faytong-Haro, M. (2024). Unveiling the core constructs: A statistical approach to evaluating user experience with chatbots in higher education (A case study from a university in Ecuador). Journal of Infrastructure, Policy and Development, 8(10), 6381. https://doi.org/10.24294/jipd.v8i10.6381
  43. Shahzad, M. F., Xu, S., An, X., and Javed, I. (2024). Assessing the impact of AI-chatbot service quality on user e-brand loyalty through chatbot user trust, experience and electronic word of mouth. Journal of Retailing and Consumer Services, 79, 103867. https://doi.org/10.1016/j.jretconser.2024.103867
  44. Silva, F. A., Shojaei, A. S., and Barbosa, B. (2023). Chatbot-based services and reuse intention. Journal of Theoretical and Applied Electronic Commerce Research, 18(1), 457-474. https://doi.org/10.3390/jtaer18010024
  45. Toteja, R., Sarkar, A., and Comar, P. M. (2025). In-context reinforcement learning with retrieval-augmented generation for text-to-SQL. In Proceedings of the 31st International Conference on Computational Linguistics (pp. 10390-10397).
  46. Werning, T. C., Escalona, M., and Hinderks, A. (2025). Linking user experience and business outcomes: How perceived usefulness of AI chatbots predicts satisfaction and NPS. In Proceedings of the 21st International Conference on Web Information Systems and Technologies (pp. 502-510). SCITEPRESS - Science and Technology Publications.
  47. Winer, R. S. (1986). A reference price model of brand choice. Journal of Consumer Research, 13(2), 250-256. https://doi.org/10.1086/209064
  48. Yang, S. S., Kimes, S. E., and Sessarego, M. M. (2009). Menu price presentation influences on consumer purchase behavior in restaurants. International Journal of Hospitality Management, 28(1), 157-160. https://doi.org/10.1016/j.ijhm.2008.06.012