DOI QR코드

DOI QR Code

The Effect of ChatGPT Factors & Innovativeness on Switching Intention : Using Theory of Reasoned Action (TRA)

  • Hee-Young CHO (The Graduate School of Industry, Sejong University) ;
  • Hoe-Chang YANG (Dep. Of Distribution Management, Jangan University) ;
  • Byoung-Jo HWANG (Cooperative Course for Urban, Real Estate and Commercial Science, Sejong University)
  • Received : 2023.07.14
  • Accepted : 2023.08.05
  • Published : 2023.08.31

Abstract

Purpose: This study examined the relationship between the factors (Credibility, Usability) and user Innovativeness of the ChatGPT on TRA (Theory of Reasoned Action; Subjective Norm, Attitude) and Switching Intention. TRA and Innovation Diffusion Theory (IDT) were used. Research design, data and methodology: From April 26 to 27, 2023, an online panel survey agency was commissioned to conduct a survey of GhatGPT users in their 20s and 40s in Korea, and a total of 210 people were used for the final analysis. Verification of the research model was performed using SPSS and AMOS. Results: First, ChatGPT factors (Credibility, Usability) were found to have positive effects on TRA (Subjective Norm, Attitude). Second, ChatGPT user Innovativeness was found to have a positive effect on TRA (Subjective Norm, Attitude). Third, ChatGPT users' TRA (Subjective Norm, Attitude) were found to have positive effects on Switching Intention. Conclusions: These results mean that the superior Usability and Credibility of ChatGPT and the Innovativeness of users have a significant effect on the Switching Intention from existing Portal Service (Naver, Google, Daum, etc.) to ChatGPT. Generative AI such as ChatGPT should strive to develop various services such as improving the convenience of functions so that innovative users can use them easily and conveniently in order to provide services that meet expectations.

Keywords

1. Introduction

Along with the development of artificial intelligence (AI) technology, the introduction of new services that combine AI is being promoted in the retail and distribution industry. The retail and distribution industry needs to pursue maximization of productivity and efficiency through data analysis using AI technology because of the nature of a large amount of data being generated every day. Due to these characteristics, various types of AI-based platforms have been developed and utilized (Gesing et al., 2018; Shin et al., 2019). In general, among AI technologies, Chatbot are widely used in retail and distribution industry, centering on Service and e-Commerce (Brandtzaeg & Følstad, 2018). ChatGPT is in the limelight as a new chatbot service.

ChatGPT is based on GPT-3.5, a modified version of GPT-3 announced by OpenAI in 2020 (Ray, 2023). Anyone can use ChatGPT for free and easily, and with its powerful performance compared to existing Artificial Intelligence (AI) services, it has attracted explosive interest, exceeding 1 million users within 5 days of starting the service and exceeding 100 million users within 2 months (Zhang, 2023). And users who want faster response times and improved access can purchase a paid subscription called ChatGPT Plus (Murugesan & Cherukuri, 2023; Yu, 2023). Now, innovative AI technologies such as ChatGPT, designed to generate sophisticated text indistinguishable from human-generated text, can be applied in a variety of contexts (Dwivedi et al., 2023).

Platform include Online marketplace, App store, Search service, and Social media (Gawer, 2021). Search service play an important role in Internet marketing and commerce. Search is the center of Portal Service strategy (Green, 2003). In Korea, there are Naver, Google, and Daum search services that occupy a large market share (Kwon, 2022). As the size of the web exploded, search services became faster and more accurate (Heaven, 2022). We have been dependent on search services like Google for decades (Hill-Yardin et al., 2023).

Using GPT is no more difficult than retrieving information through a search service (Floridi & Chiriatti, 2020). It should be noted how the existing search service, which only collects and posts information, differs from the new type of search service (Heaven, 2022). This new technology has the potential to transform the search service landscape by providing an interactive, intuitive and personalized search approach (Liu et al., 2023).

Incumbent business firms are at risk when platforms evolve rapidly and gain large market shares (Kovalenko et al., 2020). ChatGPT will be a potential threat to Google, an existing search service (Hoppner & Streatfeild, 2023). This is because platforms have a huge impact on individual users and businesses, reshaping the relationship between customers, advertisers, workers and employers (Gawer & Srnicek, 2021).

Technical research on AI in relation to ChatGPT is rapidly increasing. On the other hand, there are not many empirical studies on the factors influencing consumer behavior so far. Although ChatGPT has a short commercialization period, it is different from expressing various concerns. Numerous generative AIs have already been released, but since ChatGPT, which interacts and provides responses based on chat, is currently receiving the most attention, this study focused on the SI to ChatGPT for existing portal service users. In the current situation where competition for innovative technology development with AI is intensifying, exploring the factors that ChatGPT affects consumer behavior will broaden the academic scope of AI and retail industry (Online Platform, etc.) research from the consumer behavior perspective. It is also judged to have practical implications.

For example, operators will be able to identify who is active in switching services and who is not, so they can implement various strategies to target or keep these users.

This study aims to empirically explain the customer's Switching Intention (SI) to GhatGPT (Chat Generative Pre-trained Transfomer) at the Platform service point of view. Specifically, using the Theory of Reasoned Action (TRA) and and Innovation Diffusion Theory (IDT), we closely study the factors that can affect the Switching Intention to ChatGPT targeting Search Portal Service (Naver, Google, Daum, etc.) users among Online Platform.

Using TRA, to study the influence relationship that ChatGPT Factors (Credibility, Usability) and personal characteristics (Innovativeness) can have on the SI from existing Search Portal Service to ChatGPT through factors such as Subjective Norm (SN) and Attitude will be.

The contents of this study are as follows. Step 1, to identify the theoretical background, prior studies on ChatGPT, service factors (Credibility, Usability), personal characteristics (Innovativeness), Theory of Reasoned Action (TRA), and Switching Intention (SI) are identified. Step 2, a research model is presented, and research hypotheses are derived. Step 3 describes the research method, research content, and analyzed research results. Step 4 describes the conclusions and implications of the research results and the need for follow-up research.

2. Literature Review

2.1. Theory of Reasoned Action (TRA)

Theory of Reasoned Action (TRA) is a theoretical framework for predicting consumers' actual behavior, and is composed of attitude toward behavior, subjective norms, and behavioral intention (Ajzen & Madden, 1986). TRA proposed by Fishbein and Ajzen (1975) to explain human behavior has been widely used in research on technology acceptance in the field of information and communication technology and has become a theoretical foundation for research on technology acceptance. According to the TRA, actual behavior is directly affected by behavioral intention, and behavioral intention are determined by individual attitude and subjective beliefs (Ajzen & Fishbein, 1980; Davis, 1989; Fishbein & Ajzen, 1975).

Subjective Norm (SN) is a variable related to social factors and refers to the extent to which the thoughts and opinions of people around you affect products and services that are new alternatives (Ajzen, 1991). This has been studied as a key variable that determines technology acceptance as well as a variable that significantly affects the behavior of voluntarily choosing and converting to a new alternative (Bansal et al., 2005; Hou et al., 2011; Sun et al., 2017). It was said that the positive thoughts and opinions of people around the new alternative can have a positive effect on the behavioral will to switch to the new alternative (Wu et al., 2017). Sun et al. (2017) revealed that SN can have a positive effect on service Switching. Accordingly, this study defines SN as 'the extent to which the opinions of people around and social influence on new alternatives'.

Attitude is a learned psychological tendency to express the overall evaluation of a product or brand, or a specific entity such as price, design, origin, etc. am. And it is a learned predisposition to respond favorably or unfavorably to a certain object consistently (Fishbein & Ajzen, 1975). In addition, Attitude are formed through the process of evaluating whether an individual believes a certain event or idea through education or experience and whether the event or idea is an acceptable category (Ajzen & Fishbein, 1980; Taylor & Todd, 1995). Eagly and Chaiken (1993) defined beliefs formed as the sum of evaluations of an object formed through memory and an individual's evaluation of liking or disliking toward an object and was defined as an expression of belief.

Mun and Cho (2017) said that Behavioral Intention in the relationship between consumers and companies are largely classified into two types: favorable Behavioral Intention and Unfavorable Behavior. In this study, based on previous studies, the Behavioral Intention was composed of the Switching Intention and the research was conducted.

2.2. ChatGPT

Among AI technologies, Chatbot are widely used in retail and distribution industry, centering on Service and e-Commerce (Brandtzaeg & Følstad, 2018). ChatGPT is in the limelight as a new chatbot service. ChatGPT is a generative AI Chatbot developed by OpenAI, and GPT is short for Generative Pre-trained Transformer (Zhang, 2023; Borji, 2023; Ventayen, 2023). Based on a large amount of natural language processing data, it is an AI technology that pre-trains by applying a Transformer algorithm and generates new contents like existing contents based on this (Ray, 2023). Here, GPT is an AI tool that generates human-like text, allowing users to interact with the AI as if they were talking to someone else. People use GPT by entering prompts (text instructions in the form of questions or commands). GPT can be used like a search service (Haupt & Marks, 2023).

ChatGPT is the future of search service optimization. ChatGPT is a new chatbot from AI company OpenAI and has grown aggressively since its launch in late 2022 (Cutler, 2023). ChatGPT has been expanding to an extent incomparable to other big tech services, with more than 1 million subscribers within 5 days of starting the service. Considering that Facebook took 10 months and Apple iPhone took 74 days, it must be an innovative service (Milmo, 2023). The launch of ChatGPT sparked a global development frenzy, with companies in the technology and internet sectors as well as physical and traditional enterprises all joining the ranks of developing various application products based on ChatGPT (Yu, 2023).

ChatGPT presents information back to the querying user in a clear and understandable structure. This skill can be used for a variety of purposes, including writing code, writing business propositions, writing stories, and answering complex questions (Cutler, 2023). Compared to existing search engines and intelligent chatbots that provide mechanical answers only by keyword search, ChatGPT breaks free from the limitations of traditional indexing, searching, and sorting models by accurately understanding the meaning and intent of questions (Deng & Lin, 2023).

Above all, the biggest difference that ChatGPT has compared to existing search services is contents creation. Based on GPT-3.5, a Large Language Model (LLM), ChatGPT can write various genres and types of writing such as novels, articles, dialogues, essays, blogs, and contracts by entering the conditions of the contents to be created. In addition, it supports the creation and review of programming codes such as Python, consulting, travel planning, and evaluation item creation (Dowling & Lucey, 2023; Patel & Lam, 2023; Thorp, 2023; Van Dis et al., 2023). ChatGPT's wide range of use cases and its potential to improve user productivity in almost every industry inspire new users when it comes to this cutting-edge AI application (Xames & Shefa, 2023). Services such as Chat GPT demonstrate the ability to think and answer questions like humans, demonstrating creative abilities previously unavailable to AI, making a qualitative leap from quantitative change (Kosinski, 2023).

ChatGPT is attracting attention among web users because it has the potential to become a next-generation search service replacing Google (Singh & Singh, 2023). The next-generation AI represented by ChatGPT is leading the innovative development of intelligent technology to a new historical stage. This technology will not only have a profound impact on the way society produces, lives and communicates, but will also fundamentally reshape society and humanity (Hill-Yardin et al., 2023). Over the past 20 years, people have turned to search engines for information, news articles, images, videos, and answers to everyday, complex questions. These technological advances through chatbots represent important shifts, particularly regarding the way we think about web searches. In fact, Microsoft's decision to invest in ChatGPT and include it in the search engine Bing has already caused waves in the search service ecosystem (Cutler, 2023). Microsoft replaced the existing technology by integrating ChatGPT into Bing. Through the combination of ChatGPT and Bing, Microsoft is redefining search services (Wang et al., 2023). The development of ChatGPT technology will completely overturn human lifestyles, providing unprecedented digital experiences and enriching people's lives (Yu, 2023).

2.2.1. Credibility

Credibility means believability. In other words, a credible person refers to a believable person, and credible information refers to believable information (Tseng & Fogg, 1999). Credibility of information is an important issue in the world of interactive information systems where people post and share information through various web-based services such as websites, blogs, and SNS (Social Networking Sites) (Choi & Stvilia, 2015). Credibility refers to the degree to which information and functions of the system can be trusted when using the system (Seo, 2013). Credibility is not an inherent characteristic of a source, but a user's own judgment (Choi & Stvilia, 2015). Thus, one factor that affects Credibility is what motivates individuals to visit the site (Johnson & Kaye, 2009).

The evaluation of user's Credibility mainly appears as website properties (design, contents, complexity, etc.) rather than familiarity with websites (Flanagin & Metzger, 2007). ChatGPT can respond in a variety of styles and languages. If you didn't know there was an AI behind it, it could easily be mistaken for a chat with a real human (Wang et al., 2023). These interactive services have the characteristics of having a significant impact on customer trust, satisfaction, repurchase, and word-of-mouth intention through interactive communication (Mero, 2018). Johnson and Kaye (2004) argued that Credibility is the main factor in the continuous development of websites, and that Credibility in information increases as the quality and reputation of websites are perceived highly. The purpose of ChatGPT is to interact through a conversation involving a series of questions from the user and responses from the app (Rospigliosi, 2023). With the exponential growth of algorithms, establishing a relationship of trust between humans and AI becomes increasingly important. Algorithmic systems such as Chatbot play an important role in evaluating users' trust in algorithms. Unless the user believes that the Chatbot's information can be trusted, they are unlikely to act as suggested (Shin, 2022).

2.2.2. Usability

Venkatesh (1996) defined usability as the degree to which users can use the system comfortably, and information systems that are easy to use have a higher rate of being used by users than systems that do not (Davis, 1989; Segars & Grover, 1993; Venkatesh, 2000). In addition, usability can be defined as 'the ability of a software product to be understood, learned, used, and attractive to users when used under specified conditions' (Abran et al., 2003). Usability is one of the important factors to consider in a product or service designed to provide a good user experience and refers to the degree to which a user can complete a specific task while using a service (Albert & Tullis, 2022). Rogers (1995) pointed out that the faster a user learns how to use a product, the faster the new product is accepted in the market.

Usability is also referred to as ‘ease-of-use’ because it is related to convenience. To increase usability, only the minimum possible steps are required to achieve what you want. As a result, it can be used without looking at the written instructions, and contradictions should not be discovered while using it. In addition, usability is ergonomic to the user along with the service factor in use and makes it possible to communicate with the product. On the other hand, usability can be treated as an element that can most sensitively feel satisfaction when using the web. The contents can be searching convenience, consistency, attention, menu organization, process organization, movement convenience, and search function convenience (Kim & Jeong, 2016).

2.3. Innovativeness

Previous studies, including the study by Rogers (1995), explained the growth in demand for new products and proposed the Diffusion of Innovation theory, which states that there is a certain pattern in the phenomenon of people accepting new technologies from the viewpoint of the recipients of technological innovation. Innovativeness is a personal characteristic of how easily and quickly a product is accepted before other consumers. People with high innovativeness also explore innovative products and ideas or show an active and positive attitude toward perceived risks. Therefore, people with high innovativeness have a strong positive desire to prioritize new experiences and adoption of new products, and these characteristics affect consumption behavior (Rogers, 2003).

The adopters of new technology are divided into 5 types according to the time of acceptance of the innovation, that is, when the technology is accepted, and through the method of classifying the types according to the time of acceptance, it is possible to more easily and accurately understand the target customer group that may change over time. described (Rogers, 1995). Twum et al. (2022) found that individual innovativeness has a significant impact on e-learning platform adoption. Sitar-Taut and Mican (2021) found that individual innovativeness plays an important role in adopting mobile learning during social distancing. In addition, individual innovativeness is related to the level of students' willingness to embrace innovative technological tools such as ChatGPT and their ability to acquire and master new technologies and influences behavioral intention (Strzelecki, 2023).

2.4. Switching Intention (SI)

First, Intention is an intermediate variable between an individual's attitude and behavior that leads to future behavior and refers to the individual's subjective state (Fishbein & Ajzen, 1975). Switching Intention is the intention of a consumer to move to another alternative due to dissatisfaction with the product or service they are currently using. Switching is the opposite of maintenance in terms of changing products and services currently in use (Jones et al., 2002). Frederick et al. (2001) analyzed that customer Switching Behavior is related to business continuity, which not only attracts new customers but also causes customers to be lost to other companies. Lattin and McAlister (1985) said that since products can satisfy only a part of the diverse needs of customers, product Switching Behavior can appear as a complementary concept to satisfy the rest. In this sense, the Switching Intention is the opposite of the Continuous Use Intention.

Keaveney (1995) suggested eight factors for customers to switch suppliers in the service industry: price, inconvenience, core service failure, service contact failure, response to service failure, ethical issues, competition, and involuntary switching.

3. Methodology

3.1. Research Model

Regarding factors affecting the Switching Intention to GhatGPT, the research model of the hypotheses established in this study is as follows (see Figure 1). TRA and Innovation Diffusion Theory (IDT) were used.

OTGHB7_2023_v21n8_83_f0001.png 이미지

Figure 1: Research Model

3.2. Research Hypotheses

ChatGPT is generating considerable debate about whether it can replace search services like Google (Rachini, 2022). These changes will influence consumers' decision-making for new behaviors. Already, in a study on the intention to use a chatbot using TRA, a significant effect of subjective norm and attitude on the intention to use was confirmed (Huang & Kao, 2021).

In this study, TRA was used to identify factors influencing Switching Intention for users who had experience using ChatGPT, a generative AI, in existing search services (Naver, Google, Daum, etc.). Credibility motivates individuals to visit a site (Johnson & Kaye, 2009). The purpose of ChatGPT is to interact through conversation (Rospigliosi, 2023). Therefore, the Credibility of ChatGPT is a very important issue. Credibility is a factor that enables developers to make user decisions. In this study, Credibility was defined as ‘Credibility level of information provided by ChatGPT’, and the contents of the Credibility questionnaire were set to the level of credibility in information, accuracy of explanation, and believability in service results.

The faster the user learns how to use it, the faster the new product is accepted in the market (Rogers, 1995). ChatGPT has more than 1 million subscribers within 5 days of service launch (Milmo, 2023). Usability is the most sensitive element to feel satisfaction when using the web (Kim & Jeong, 2016). In this study, Usability was defined as ‘the level of feeling comfortable using ChatGPT functions’, and the usability questionnaire was set to the convenience of response function, convenience of support function, and overall convenience. As follows, H1 examines the effect of ChatGPT factors on TRA.

H1: The ChatGPT Factors have a significant positive (+) effect on TRA.

H1-1: ChatGPT's Credibility has a significant positive (+) effect on Subjective Norm.

H1-2: ChatGPT's Credibility has a significant positive (+) effect on Attitude.

H1-3: ChatGPT's Usability has a significant positive (+) effect on Subjective Norm.

H1-4: ChatGPT's Usability has a significant positive (+) effect on Attitude.

Innovativeness differs from person to person, and the degree of individual innovation affects the acceptance of products and services (Hirschman, 1980). It can be expected that consumers with high innovativeness will have a high intention to accept new technologies (Agarwal & Prasad, 1998). Therefore, as it is expected that an individual's will to use ChatGPT will have a positive effect on Switching Intention, this study predicted that individual Innovativeness related to ChatGPT has a positive effect on Switching Intention. In this study, innovativeness was defined as ‘the level of willingness to use ChatGPT voluntarily’ and the contents of the questionnaire about innovativeness were set to the degree of activeness of use, enjoyment of use, and interest in use.

H2: The User Characteristics have a significant positive (+) effect TRA.

H2-1: User’s Innovativeness has a significant positive (+) effect on Subjective Norm.

H2-2: User’s Innovativeness has a significant positive (+) effect on Attitude.

Once the consumer's Switching Intention is identified, the company can form a lasting relationship with the consumer through activities such as marketing and service improvement or use it as an element that induces other service user's switching. Therefore, research on the Switching Intention to GhatGPT, a new service, is also important in practice. This study focuses on the Switching Intention, which is the Behavioral Intention of negative customers, as a variable that can determine switching to ChatGPT. This study defined Switching Intention as ‘the will to replace the currently used Search service with ChatGPT’. And the contents of the questionnaire regarding Switching Intention were set to the degree of consideration of switching, switching to ChatGPT, and willingness to switching.

H3: The ChatGPT user’s TRA Factors have a significant positive (+) effect TRA.

H3-1: ChatGPT user’s Subjective Norm has a significant positive (+) effect on Switching Intention.

H3-2: ChatGPT user’s Attitude has a significant positive (+) effect on Switching Intention.

3.3. Research Design

In this study, the questionnaire was divided into 4 concepts to verify the hypotheses established. First, ChatGPT factors consisted of two factors: Credibility (3 indicators) and Usability (3 indicators), and Innovativeness (3 indicators) was composed of one factor of personal characteristics. TRA consisted of Subjective Norm (3 indicators) and Attitude (3 indicators) as factors.

In addition, based on the preceding studies, the consumer's behavioral intention was configured as a single dimension of 'Switching Intention’ (3 indicators), a variable that can determine the Switching of existing Portal Service users to ChatGPT. As above, a total of 6 multi-item measurement concepts were set and used, and the measurement tool of this study consisted of a total of 18 indicators. Each item in this study was measured on a 5-point Likert scale of ‘1 = not at all’ and ‘5 = very much so’. In addition, 3 items related to the experience of using ChatGPT were composed, and demographic characteristics were composed of 5 items.

3.4. Sampling and Data Collection

This study conducted a survey using TRA to verify the effects of ChatGPT factors (Credibility, Usability) and personal characteristics (Innovativeness) on consumers' Subjective Norm, Attitude and Switching Intention.

From April 26 to 27, 2023, an online panel survey agency was commissioned to conduct a survey of GhatGPT users in their 20s and 40s in Korea, and a total of 210 people were used for the final analysis. And the collected sample data were subjected to empirical analysis with SPSS and AMOS statistical programs. The surveyed sample was subjected to frequency analysis to examine demographic characteristics. In addition, reliability analysis, exploratory factor analysis, and confirmatory factor analysis were conducted to confirm the validity and internal consistency of the questionnaire items. Discriminant validity analysis was conducted to determine validity between constructs and Structural Equation Model (SEM) analysis was conducted to check the fit between the research hypothesis and the model. SEM is appropriate for examining and analyzing an existing theory (Hair et al., 2019).

4. Results and Discussion

4.1. Demographic Information

Among the 210 survey respondents in this study, male 76 (36.2%) and female 134 (63.8%). By age group, 96 (45.7%) in their 30s, followed by 65 (31.0%) in their 40s and 49 (23.3%) in their 20s (see Table 1).

Table 1: Respondents’ demographic information

OTGHB7_2023_v21n8_83_t0001.png 이미지

4.2. Measurement Model

Reliability and validity were confirmed prior to hypothesis testing. To confirm that the internal consistency of the measurement items was secured, Cronbach's Alpha coefficient was verified in terms of reliability between measurement items, and validity between measurement concepts was confirmed through confirmatory factor analysis (see Table 2). Looking at Table 2, since the Cronbach's Alpha values of the seven measured items all show .7 or higher, it can be judged that internal consistency has been secured (Nunnally & Berstein, 1994; Hair et al., 2010; Xia & Yang, 2019). Looking at the results of confirmatory factor analysis (CFA) conducted for singledimensional verification of the measurement items, χ² = 137.930, df = 120, p= .126, χ²/df = 1.149, RMR = .030, RMSEA = .027, GFI = .932, AGFI = .903, NFI = .948, CFI = .993, NFI = .948, RFI = .934. The χ²/df value shows the change of χ² according to the increase or decrease of the degree of freedom. If it is less than 3, the overall fit is satisfied. The overall fit of the theoretical model established by the set factors can be considered good as the measurement results of all other fit indices show that the standards are acceptable (Bentler & Bonett, 1980).

Table 2: Reliability Test and Confirmatory Factor Analysis Results

OTGHB7_2023_v21n8_83_t0002.png 이미지

Notes 1: χ²=137.930, df=120, p= .126, χ²/ df =1.149, RMR= .030, RMSEA= .027, GFI= .932, AGFI= .903, NFI= .948, CFI= .993, NFI= .948, RFI= .934

Notes 2: * p < .001

Notes 3: AVE: Average Variance Extracted

Notes 4: CR: Composite/Construct Reliability

In addition, in order to evaluate whether the measurement scales of this study are representative of the concepts, the composite/construct reliability (CR) and average variance extracted (AVE) values of the constructs were calculated and confirmed. In Table 2, the lowest value of the CR .747 and the lowest value of AVE .505. This satisfies the criteria (CR .6 or more, AVE .5 or more) presented in previous studies (Bagozzi & Yi, 1988).

The discriminant validity and law validity of each research concept were measured, and the results are shown in Table 3. The AVE value, correlation coefficient, and squared value of correlation coefficient were calculated, and discriminant validity and law validity were confirmed based on these values.

Table 3: Discriminant Validity by Correlation Analysis

OTGHB7_2023_v21n8_83_t0003.png 이미지

Notes 1: The diagonal value is AVE.

Notes 2: * p< .05, ** p< .01, *** p< .001

Notes 3: Parentheses( ): Squared value of correlation coefficient

In discriminant validity, the AVE value should be greater than the squared value of correlation coefficient, and in law validity, if the correlation between latent variables agrees in the same direction as the research hypothesis, it meets the validity condition (Fornell & Larcker, 1981). Therefore, discriminant validity compares the AVE value and the squared value of correlation coefficient. It is confirmed that the squared values of correlation coefficients in this study are generally lower than the AVE values. And, as suggested in the hypothesis, since the signs of all correlation coefficients are positive (+) result values, it can be seen that the validity of the law has also been secured.

4.3. Structural Equation Model (SEM)

Table 4 shows the results obtained through the verification analysis of the overall model for this study. The fitness values of the model were χ² = 186.079, df = 124, χ²/df = 1.501, RMR = .049, RMSEA = .049, GFI = .913, AGFI = .880, NFI = .930, CFI = .975. Comparing the goodness-of-fit values of the structural model derived in this study with the numerical indicators used as the evaluation criteria for structural equations, it was found that the overall measurement results were at a level acceptable to the criteria (Bentler & Bonett, 1980; Hair et al., 2010).

Table 4: Hypotheses testing results

OTGHB7_2023_v21n8_83_t0004.png 이미지

Model Fit: χ²=186.079, df=124, p= .000, χ²/df=1.501, RMR= .049, RMSEA= .049, GFI= .913, AGFI= .880, NFI= .930, CFI= .975

Notes 1: *p< .05; **p< .01; ***p< .001

Therefore, the goodness of fit of the structural model in this study is judged to be sufficient to explain the causal relationship between the constructs.

The detailed analysis results on Switching Intention to ChatGPT with TRA and IDT applied are as follows.

The H1 research hypothesis was accepted. ChatGPT's factors (Credibility, Usability) found to have a significant positive (+) effect on TRA (Subjective Norm, Attitude). Moreover, Usability was found to have a more positive effect on all sub-factors of TRA than Credibility. Evaluation based on the path coefficient is as follows. Among the TRA factors, the ChatGPT’s Usability show an effect of .487 (t-value = 6.248; p < .001) on Attitude and .432 (t-value = 4.776; p < .001) on Subjective Norm. And, Among the TRA factors, the ChatGPT’s Credibility show an effect of .234 (t-value = 3.504; p < .001) on Attitude and .205 (t-value = 2.737; p < .01) on Subjective Norm.

The H2 research hypothesis was accepted. All ChatGPT user characteristics (Innovativeness) had a significant positive (+) effect on TRA (Subjective Norm, Attitude). Evaluation based on the path coefficient is as follows. Among the TRA factors, the ChatGPT user Innovativeness show an effect of .290 (t-value = 3.729; p < .001) on Subjective Norm and .213 (t-value = 3.181; p < .01) on Attitude.

The H3 research hypothesis was accepted. Both Subjective Norm and Attitude of ChatGPT user found to have a significant positive (+) effect on Switching Intention. Evaluation based on the path coefficient is as follows. The ChatGPT user’s Attitude .448 (t-value = 5.236; p < .001), and the Subjective Norm .226 (t-value = 2.621; p < .01), show an effect on Switching Intention. Moreover, Among the sub-factors of TRA, ChatGPT user’s Attitude found to have a greater influence on the Switching Intention to ChatGPT of existing Portal Service users than Subjective Norm.

4.4. Discussion

Since its official launch in November 2022, ChatGPT has quickly attracted numerous users with extensive media coverage. This unprecedented interest motivates numerous researchers to study GhatGPT from various aspects (Zhang et al., 2023). This study examined the factors influencing the Switching Intention to ChatGPT for users of existing Portal Service (Naver, Google, Daum, etc.)

First, as reviewed above, the factor that had the greatest influence on the Switching Intention to ChatGPT in this study was Usability among the factors of ChatGPT. Next is Credibility. The results of this study mean that the Usability of ChatGPT is a more important factor for users than the Credibility of information in using ChatGPT. This means that ChatGPT users perceive that ChatGPT's response function, support function, and general functions are more convenient than credibility of information provided by ChatGPT, accuracy of explanation, and credibility in service results. Credibility is important in the rational decision-making process of ChatGPT users, but Usability has more influence on the use of ChatGPT. This result is consistent with related previous studies (Albert & Tullis, 2022; Davis, 1989; Segars & Grover, 1993; Venkatesh, 2000). ChatGPT is good at basic information retrieval and concept explanation (Zhu et al., 2023). ChatGPT can be used for free, but a paid version has been released for the Usability of users, and an iPhone app has recently been released. OpenAI is making various efforts such as adding plug-in functions so that users can use ChatGPT conveniently (Miao & Ahn, 2023; Velazco, 2023; Yu, 2023).

Second, it was found that there was a positive influence relationship between ChatGPT users' Innovativeness and TRA (Subjective Norm, Attitude). According to previous studies, personal characteristics (Innovativeness) are one of the important factors in choosing new technologies and services (Rogers, 2003; Sitar-Taut & Mican, 2021; Strzelecki, 2023; Twum et al., 2022). Through innovation, AI opens new opportunities through personalized and interactive experiences (Firat, 2023). The digital revolution is leading to the emergence of companies using innovative business models represented by Platform. A characteristic of the Platform is that it proposes new and attractive values to users (Kovalenko et al., 2020). And, the success of a platform is highly dependent on the number and quality of its users (Lee et al., 2019). Innovativeness individuals are active, enjoy, and interested in using new technologies and services. This was also confirmed in this study.

Third, as reviewed above, this study confirmed that the existing Portal Service users' Switching Intention to ChatGPT had a positive influence relationship among the factors of ChatGPT, individual Innovativeness, and TRA (Subjective Norm, Attitude) (Huang & Kao, 2021; Mun & Cho, 2017; Sun et al., 2017; Wu et al., 2017). The most important purpose of this study is to confirm the Switching Intention of existing Portal Service users to ChatGPT. The results of this study support this.

In particular, the Attitude of ChatGPT users has a high influence on Switching Intention. It is believed that most users have favorable feelings toward the new technology and service called ChatGPT. This means that the Switching Intention from the existing Portal Service to ChatGPT can be linked to action. ChatGPT is a platform that can expect Network Effect by providing the same interaction service as humans. It is expected that it will be useful for consumers of Online Platform such as e-Commerce in the future.

5. Conclusions

AI is one of the most disruptive technologies of the 21st century (Wamba et al., 2021), and ChatGPT is a disruptive innovation (Haque et al., 2022), which is now becoming the new reality (Hamed & Wu, 2023). ChatGPT is taking the technology and business realms by storm, presenting unexpected opportunities, concerns and challenges (Murugesan & Cherukuri, 2023). Along with the spread of mobile, Chatbot have been installed on various platforms in the retail and distribution industry to increase convenience, and the scope of their use has spread widely (Lee & Kim, 2020). The Search service is closely related to the retail and distribution industry and connects consumers and retail and distribution companies through Chatbot and Recommendation System. It is consistent with the claim that the retail and distribution industry is maximizing productivity and efficiency through data analysis using artificial intelligence technology (Gesing et al., 2018; Shin et al., 2019).

5.1. Theoretical Contributions

The theoretical implications of this study are as follows. This study is differentiated in that it confirmed the existing portal service users to switching intention to ChatGPT. This study explored in-depth using TRA (Subjective norm, Attitude) in relation to ChatGPT. Credibility, Usability, and Innovativeness were redefined and analyzed according to the research model by referring to previous studies related to the factors and personal characteristics of ChatGPT. This study will be the basis for continuous academic research related to AI-based products/services that will be released in various ways in the future as AI technology is developing very rapidly. Studies related to ChatGPT are mostly technical studies. Overseas, some studies from the perspective of consumer behavior in the medical and educational fields have begun, but in Korea, related studies are insufficient (Strzelecki, 2023; Shahsavar & Choudhury, 2023; Bonsu & Baffour-Koduah, 2023; Raman et al., 2023). In the future, it is possible to expand research in various directions such as customer experience, technology acceptance, immersion, and relationship quality. In particular, Platforms in the retail and distribution industry are introducing various AI technologies. Chatbot and Recommendation System are typical examples (Brandtzaeg & Følstad, 2018; Smith & Linden, 2017). Research on the acceptance of AI technology from the consumer behavior perspective has great implications for the retail and distribution industry, such as platforms.

5.2. Practical Implications

The practical implications of this study are as follows. This study examined the user experience related to the consumer's Switching Intention from a positive point of view, focusing on ChatGPT. It reviews the direction of related services and suggests a practical approach to increase Usability related to Switching Intention. At the same time, it has the purpose of suggesting alternative development plans that can increase the Usability and Credibility of existing Portal Service (Naver, Google, Daum, etc.). ChatGPT can provide enhanced consumer engagement, enhanced customer service, personalization and shopping, social interaction and communication, cost efficiencies and insights into consumer behavior, and enhanced marketing efforts (Paul et al., 2023). ChatGPT is a new generative AI Chatbot that is expected to dominate our society along with recommendation systems in the future. Chatbot are one of the technologies that could revolutionize e-Commerce once again. Chatbot are the future of marketing and can be integrated with various SNS and replace mobile applications for shopping (Kasilingam, 2020). In the future, more advanced technology could emerge that could change the shape of Chatbot, or the way people chat to improve the user experience. Based on content creation, GhatGPT can be closely integrated with people's daily lives to build a deep relationship with each individual. And it deeply affects people's behavior patterns and promotes continuous innovation (Yu, 2023).

5.3. Limitations and Future Research Directions

Despite its academic contributions and practical implications, this study has several limitations. This needs to be reviewed in future studies.

First, more diverse analyzes (mediating effects, etc.) using SEM are needed. Second, in addition to the latent variables (Credibility, Usability, Innovativeness) of this study, it is necessary to discover/research various latent variables. Third, it is necessary to understand the influence relationship of consumer behavior according to 'online subscription', which is a general profit model of platform services.

Appendixes

References

  1. Abran, A., Khelifi, A., Suryn, W., & Seffah, A. (2003). Usability meanings and interpretations in ISO standards. Software quality journal, 11(4), 325-338. https://doi.org/10.1023/A:1025869312943
  2. Agarwal, R., & Prasad, J. (1998). A conceptual and operational definition of personal innovativeness in the domain of information technology. Information systems research, 9(2), 204-215. https://doi.org/10.1287/isre.9.2.204
  3. Ajzen, I. (1991). The theory of planned behavior. Organizational behavior and human decision processes, 50(2), 179-211. https://doi.org/10.1016/0749-5978(91)90020-T
  4. Ajzen, I., & Fishbein, M. (1980). Attitude understanding and predicting social behavior. Prentice-Hall.
  5. Ajzen, I., & Madden, T. J. (1986). Prediction of goal-directed behavior: Attitudes, intentions, and perceived behavioral control. Journal of experimental social psychology, 22(5), 453-474. https://doi.org/10.1016/0022-1031(86)90045-4
  6. Albert, B., & Tullis, T. (2022). Measuring the User Experience: Collecting, Analyzing, and Presenting UX Metrics. Morgan Kaufmann.
  7. Bagozzi, R. P., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74-94. https://doi.org/10.1007/BF02723327
  8. Bansal, H. S., Taylor, S. F., & St. James, Y. (2005). "Migrating" to new service providers: Toward a unifying framework of consumers' switching behaviors. Journal of the Academy of Marketing Science, 33(1), 96-115. https://doi.org/10.1177/0092070304267928
  9. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological bulletin, 88(3), 588-606. https://doi.org/10.1037/0033-2909.88.3.588
  10. Bonsu, E. M., & Baffour-Koduah, D. (2023). From the consumers' side: Determining students' perception and intention to use ChatGPT in Ghanaian higher education. Journal of Education, Society & Multiculturalism, 4(1), 1-29. https://doi.org/10.2478/jesm-2023-0001
  11. Borji, A. (2023). A categorical archive of chatgpt failures. arXiv preprint arXiv:2302.03494. https://doi.org/10.48550/arXiv.2302.03494
  12. Brandtzaeg, P. B., & Folstad, A. (2018). Chatbots: changing user needs and motivations. Interactions, 25(5), 38-43. https://doi.org/10.1145/3236669
  13. Choi, W., & Stvilia, B. (2015). Web credibility assessment: Conceptualization, operationalization, variability, and models. Journal of the Association for Information Science and Technology, 66(12), 2399-2414. https://doi.org/10.1002/asi.23543
  14. Cutler, K. (2023). ChatGPT and search engine optimisation: The future is here. Applied Marketing Analytics, 9(1), 8-22.
  15. Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly, 13(3), 319-340. https://doi.org/10.2307/249008
  16. Deng, J., & Lin, Y. (2023). The benefits and challenges of ChatGPT: An overview. Frontiers in Computing and Intelligent Systems, 2(2), 81-83. https://doi.org/10.54097/fcis.v2i2.4465
  17. Dowling, M., & Lucey, B. (2023). ChatGPT for (finance) research: The Bananarama conjecture. Finance Research Letters, 53, 103662. https://doi.org/10.1016/j.frl.2023.103662
  18. Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). "So what if ChatGPT wrote it?" Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
  19. Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes. Harcourt brace Jovanovich college publishers.
  20. Firat, M. (2023). How chat GPT can transform autodidactic experiences and open education. Department of Distance Education, Open Education Faculty, Anadolu Unive. doi:10.31219/osf.io/9ge8m
  21. Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention and behavior: an introduction to theory and research. Addison Wesley, 5, 177-189.
  22. Flanagin, A. J., & Metzger, M. J. (2007). The role of site features, user attributes, and information verification behaviors on the perceived credibility of web-based information. New media & society, 9(2), 319-342. https://doi.org/10.1177/1461444807075015
  23. Floridi, L., & Chiriatti, M. (2020). GPT-3: Its nature, scope, limits, and consequences. Minds and Machines, 30, 681-694. https://doi.org/10.1007/s11023-020-09548-1
  24. Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, 18(1), 39-50. https://doi.org/10.1177/002224378101800104
  25. Frederick F., Reichheld, & Teal, T. (2001). The Loyalty Effect: The Hidden Force Behind Growth, Profits, and Lasting Value. Harvard Business School Press.
  26. Gawer, A. (2021). Digital platforms' boundaries: The interplay of firm scope, platform sides, and digital interfaces. Long Range Planning, 54(5), 102045. https://doi.org/10.1016/j.lrp.2020.102045
  27. Gawer, A. R., & Srnicek, N. (2021). Online platforms: Economic and societal effects. Panel for the Future of Science and Technology (STOA) European Parliament. doi:10.2861/844602
  28. Gesing, B., Peterson, S. J., & Michelsen, D. (2018). Artificial intelligence in logistics. DHL Customer Solutions & Innovation,
  29. Green, D. C. (2003). Search Engine Marketing: Why it benefits us all. Business Information Review, 20(4), 195-202. https://doi.org/10.1177/0266382103204005
  30. Hair, J. F., Anderson, R. E., Babin, B. J., & Black, W. C. (2010). Multivariate Data Analysis: A Global Perspective, vol. 7 Pearson Education. Upper Saddle River, NJ.
  31. Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate Data Analysis. United Kingdom: Cengage Learning.
  32. Hamed, A. A., & Wu, X. (2023). Improving Detection of ChatGPT-Generated Fake Science Using Real Publication Text: Introducing xFakeBibs a Supervised-Learning Network Algorithm. https://doi.org/10.21203/rs.3.rs-2851222/v1
  33. Haque, M. U., Dharmadasa, I., Sworna, Z. T., Rajapakse, R. N., & Ahmad, H. (2022). "I think this is the most disruptive technology": Exploring Sentiments of ChatGPT Early Adopters using Twitter Data. arXiv preprint arXiv:2212.05856. https://doi.org/10.48550/arXiv.2212.05856
  34. Haupt, C. E., & Marks, M. (2023). AI-generated medical advice-GPT and beyond. Jama, 329(16), 1349-1350. doi:10.1001/jama.2023.5321
  35. Heaven, W. D. (2022). Language Models Like GPT-3 Could Herald a New Type of Search Engine. Ethics of Data and Analytics: Concepts and Cases, 57-59. https://doi.org/10.1201/9781003278290-9
  36. Hill-Yardin, E. L., Hutchinson, M. R., Laycock, R., & Spencer, S. J. (2023). A Chat (GPT) about the future of scientific publishing. Brain Behav Immun, 110, 152-154. doi:10.1016/j.bbi.2023.02.022
  37. Hirschman, E. C. (1980). Innovativeness, novelty seeking, and consumer creativity. Journal of consumer research, 7(3), 283-295. https://doi.org/10.1086/208816
  38. Hoppner, T., & Streatfeild, L. (2023). Chatgpt, bard & co.: An introduction to ai for competition and regulatory lawyers. An Introduction to AI for Competition and Regulatory Lawyers (February 23, 2023), 1-9. http://dx.doi.org/10.2139/ssrn.4371681
  39. Hou, A. C., Chern, C. C., Chen, H. G., & Chen, Y. C. (2011). 'Migrating to a new virtual world': Exploring MMORPG switching through human migration theory. Computers in Human Behavior, 27(5), 1892-1903. https://doi.org/10.1016/j.chb.2011.04.013
  40. Huang, Y. S., & Kao, W. K. (2021). Chatbot service usage during a pandemic: fear and social distancing. The Service Industries Journal, 41(13-14), 964-984. https://doi.org/10.1080/02642069.2021.1957845
  41. Johnson, T. J., & Kaye, B. K. (2004). For whom the Web toils: How Internet experience predicts Web reliance and credibility. Atlantic Journal of Communication, 12(1), 19-45. https://doi.org/10.1207/s15456889ajc1201_3
  42. Johnson, T. J., & Kaye, B. K. (2009). In blog we trust? Deciphering credibility of components of the internet among politically interested internet users. Computers in Human Behavior, 25(1), 175-182. https://doi.org/10.1016/j.chb.2008.08.004
  43. Jones, M. A., Mothersbaugh, D. L., & Beatty, S. E. (2002). Why customers stay: measuring the underlying dimensions of services switching costs and managing their differential strategic outcomes. Journal of business research, 55(6), 441-450. https://doi.org/10.1016/S0148-2963(00)00168-5
  44. Kasilingam, D. L. (2020). Understanding the attitude and intention to use smartphone chatbots for shopping. Technology in Society, 62, 101280. https://doi.org/10.1016/j.techsoc.2020.101280
  45. Keaveney, S. M. (1995). Customer switching behavior in service industries: An exploratory study. Journal of marketing, 59(2), 71-82. https://doi.org/10.1177/002224299505900206
  46. Kim, Y. S., & Jeong, B. G. (2016). A study on facts of the user experience in online stores-Focusing on companies that participated in K-sale day. Korean Journal of Design Culture, 22(1), 53-62.
  47. Kosinski, M. (2023). Theory of mind may have spontaneously emerged in large language models. arXiv preprint arXiv:2302.02083. https://doi.org/10.48550/arXiv.2302.02083
  48. Kovalenko, B., Kolyshkin, A., & Kovalenko, E. (2020). Platforms as the Terms of Organizational Leadership in the Digital Economy. In 6th International Conference on Social, economic, and academic leadership (ICSEAL-6-2019), 441, 415-421. Atlantis Press. https://doi.org/10.2991/assehr.k.200526.060
  49. Kwon, H. J. (2022). A New Trend of Tourism in the Post-COVID19 Era: Big Data Analysis of Online Tours in Korea. Social Sciences, 11(12), 574. https://doi.org/10.3390/socsci11120574
  50. Lattin, J. M., & McAlister, L. (1985). Using a variety-seeking model to identify substitute and complementary relationships among competing products. Journal of marketing research, 22(3), 330-339. https://doi.org/10.1177/002224378502200308
  51. Lee, K. J., & Kim, E. Y. (2020). The role and effect of artificial intelligence (ai) on the platform service innovation: The case study of Kakao in Korea. Knowledge Management Research, 21(1), 175-195.
  52. Lee, S., Lee, S. Y., & Ryu, M. H. (2019). How much are sellers willing to pay for the features offered by their e-commerce platform?. Telecommunications Policy, 43(10), 101832. https://doi.org/10.1016/j.telpol.2019.101832
  53. Lee, Y., & Shin, D. (2020). A study on the online assessment using artificial intelligence for distance education. Journal of Learner-Centered Curriculum and Instruction, 20(14), 389-407.
  54. Liu, Z., Yu, X., Zhang, L., Wu, Z., Cao, C., Dai, H., ... & Li, X. (2023). Deid-gpt: Zero-shot medical text de-identification by gpt-4. arXiv preprint arXiv:2303.11032. https://doi.org/10.48550/arXiv.2303.11032
  55. Mero, J. (2018). The effects of two-way communication and chat service usage on consumer attitudes in the e-commerce retailing sector. Electronic Markets, 28, 205-217. https://doi.org/10.1007/s12525-017-0281-2
  56. Miao, H., & Ahn, H. (2023). Impact of ChatGPT on interdisciplinary nursing education and research. Asian/Pacific Island Nursing Journal, 7(1), e48136. doi:10.2196/48136
  57. Milmo, D. (2023). ChatGPT reaches 100 million users two months after launch. The Guardian,
  58. Mun, S. R., & Cho, Y. B. (2017). The effects of dining out choice attributes on behavioral intention according to foodservice consumption. J Foodserv Manage, 20(5), 51-72.
  59. Murugesan, S., & Cherukuri, A. K. (2023). The Rise of Generative Artificial Intelligence and Its Impact on Education: The Promises and Perils. Computer, 56(5), 116-121. doi:10.1109/MC.2023.3253292
  60. Nunnally, J. C., & Berstein, I. H. (1994). Psychometric Theory. 3. Edit. McCraw-Hill. Inc. New York.
  61. Patel, S. B., & Lam, K. (2023). ChatGPT: the future of discharge summaries?. The Lancet Digital Health, 5(3), e107-e108. https://doi.org/10.1016/S2589-7500(23)00021-3
  62. Rachini, M. (2022). ChatGPT a'landmark event'for AI, but what does it mean for the future of human labour and disinformation?. CBC, December, 15.
  63. Raman, R., Mandal, S., Das, P., Kaur, T., Sanjanasri, J. P., & Nedungadi, P. (2023). University students as early adopters of ChatGPT: Innovation Diffusion Study. https://doi.org/10.21203/rs.3.rs-2734142/v1
  64. Paul, J., Ueno, A., & Dennis, C. (2023). ChatGPT and consumers: Benefits, pitfalls and future research agenda. International Journal of Consumer Studies, 47(4), 1213-1225. https://doi.org/10.1111/ijcs.12928
  65. Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
  66. Rogers, E. M. (1995). Diffusion of Innovations 4th ed. The Free Press, New York.
  67. Rogers, E. M. (2003). Diffusion of Innovations 5th ed. The Free Press, New York.
  68. Rospigliosi, P. A. (2023). Artificial intelligence in teaching and learning: what questions should we ask of ChatGPT?. Interactive Learning Environments, 31(1), 1-3. https://doi.org/10.1080/10494820.2023.2180191
  69. Segars, A. H., & Grover, V. (1993). Re-examining perceived ease of use and usefulness: A confirmatory factor analysis. MIS quarterly, 17(4). 517-525. https://doi.org/10.2307/249590
  70. Seo, K. K. (2013). Factor analysis of the cloud service adoption intension of Korean firms: applying the TAM and VAM. Journal of Digital Convergence, 11(12), 155-160. https://doi.org/10.14400/JDPM.2013.11.12.155
  71. Shahsavar, Y., & Choudhury, A. (2023). The Role of AI Chatbots in Healthcare: A Study on User Intentions to Utilize ChatGPT for Self-Diagnosis. JMIR Preprints. https://doi.org/10.2196/preprints.47564
  72. Shin, D. (2022). How do people judge the credibility of algorithmic sources?. Ai & Society, 37(1), 81-96. https://doi.org/10.1007/s00146-021-01158-4
  73. Shin, K. Y., Lee, J. K., Kang, K. H., Hong, W. G., & Han, C. H. (2019). The current applications and future directions of artificial intelligence for military logistics. Journal of Digital Contents Society, 20(12), 2433-2444. doi:10.9728/dcs.2019.20.12.2433
  74. Singh, H., & Singh, A. (2023). ChatGPT: Systematic Review, Applications, and Agenda for Multidisciplinary Research. Journal of Chinese Economic and Business Studies, 21(2), 193-212. https://doi.org/10.1080/14765284.2023.2210482
  75. Sitar-Taut, D. A., & Mican, D. (2021). Mobile learning acceptance and use in higher education during social distancing circumstances: An expansion and customization of UTAUT2. Online Information Review, 45(5), 1000-1019. https://doi.org/10.1108/OIR-01-2021-0017
  76. Smith, B., & Linden, G. (2017). Two decades of recommender systems at Amazon. com. Ieee internet computing, 21(3), 12-18. doi: 10.1109/MIC.2017.72
  77. Strzelecki, A. (2023). To use or not to use ChatGPT in higher education? A study of students' acceptance and use of technology. Interactive Learning Environments, 1-14. https://doi.org/10.1080/10494820.2023.2209881
  78. Sun, Y., Liu, D., Chen, S., Wu, X., Shen, X. L., & Zhang, X. (2017). Understanding users' switching behavior of mobile instant messaging applications: An empirical study from the perspective of push-pull-mooring framework. Computers in Human Behavior, 75, 727-738. https://doi.org/10.1016/j.chb.2017.06.014
  79. Taylor, S., & Todd, P. A. (1995). Understanding information technology usage: A test of competing models. Information systems research, 6(2), 144-176. https://doi.org/10.1287/isre.6.2.144
  80. Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313-313. doi: 10.1126/science.adg7879
  81. Tseng, S., & Fogg, B. J. (1999). Credibility and computing technology. Communications of the ACM, 42(5), 39-44. https://dl.acm.org/doi/fullHtml/10.1145/301353.301402
  82. Twum, K. K., Ofori, D., Keney, G., & Korang-Yeboah, B. (2022). Using the UTAUT, personal innovativeness and perceived financial cost to examine student's intention to use E-learning. Journal of Science and Technology Policy Management, 13(3), 713-737. https://doi.org/10.1108/JSTPM-12-2020-0168
  83. Van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023). ChatGPT: five priorities for research. Nature, 614(7947), 224-226. https://doi.org/10.1038/d41586-023-00288-7
  84. Velazco, C. (2023, May 19). ChatGPT has an official app now. You can even talk to it. Washington Post, NA. https://link.gale.com/apps/doc/A749836647/AONE?u=anon~155e0867&sid=googleScholar&xid=6f709c20
  85. Venkatesh, A. (1996). Computers and other interactive technologies for the home. Communications of the ACM, 39(12), 47-54. https://doi.org/10.1145/240483.240491
  86. Venkatesh, V. (2000). Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Information systems research, 11(4), 342-365. https://doi.org/10.1287/isre.11.4.342.11872
  87. Ventayen, R. J. M. (2023). OpenAI ChatGPT generated results: Similarity index of artificial intelligence-based contents. Available at SSRN 4332664. http://dx.doi.org/10.2139/ssrn.4332664
  88. Wamba, S. F., Bawack, R. E., Guthrie, C., Queiroz, M. M., & Carillo, K. D. A. (2021). Are we preparing for a good AI society? A bibliometric review and research agenda. Technological Forecasting and Social Change, 164, 120482. https://doi.org/10.1016/j.techfore.2020.120482
  89. Wang, F. Y., Miao, Q., Li, X., Wang, X., & Lin, Y. (2023). What does ChatGPT say: The DAO from algorithmic intelligence to linguistic intelligence. IEEE/CAA Journal of Automatica Sinica, 10(3), 575-579. https://doi.org/10.1109/JAS.2023.123486
  90. Wu, K., Vassileva, J., & Zhao, Y. (2017). Understanding users' intention to switch personal cloud storage services: Evidence from the Chinese market. Computers in Human Behavior, 68, 300-314. https://doi.org/10.1016/j.chb.2016.11.039
  91. Xames, M. D., & Shefa, J. (2023). ChatGPT for research and publication: Opportunities and challenges. Journal of Applied Learning and Teaching, 6(1), 1-6. https://doi.org/10.37074/jalt.2023.6.1.20
  92. Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior research methods, 51, 409-428. https://doi.org/10.3758/s13428-018-1055-2
  93. Yu, H. (2023). Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching. Frontiers in Psychology, 14, 1-12. https://doi.org/10.3389/fpsyg.2023.1181712
  94. Zhang, B. (2023). ChatGPT, an Opportunity to Understand More About Language Models. Medical Reference Services Quarterly, 42(2), 194-201. https://doi.org/10.1080/02763869.2023.2194149
  95. Zhang, C., Zhang, C., Li, C., Qiao, Y., Zheng, S., Dam, S. K., Zhang, M., Kim, J. U., Kim, Se. T., Choi, J., Park, G. M., Bae, S. H., Lee, L. H., Hui, P., Kweon, I. S., & Hong, C. S. (2023). One small step for generative ai, one giant leap for agi: A complete survey on chatgpt in aigc era. arXiv preprint arXiv:2304.06488. https://doi.org/10.48550/arXiv.2304.06488
  96. Zhu, J. J., Jiang, J., Yang, M., & Ren, Z. J. (2023). ChatGPT and environmental research. Environmental Science & Technology. https://doi.org/10.1021/acs.est.3c01818