This study aims to investigate the effects of different types of chatbots on knowledge learning performance and continuous usage intention by designing thought-guided and affective thought-guided chatbots. Drawing on coping theory, the study further seeks to uncover the underlying mechanism, focusing on perceptions of three nuanced aspects of transparency—social, expressive and diagnostic—and cognitive effort in human–artificial intelligence interactions.
Two experiments were conducted to investigate the impacts. A within-subjects experiment compared search engines and popular simple chatbots. A between-subjects experiment added thought-guided and affective thought-guided chatbots. Analysis of variance and partial least squares structural equation modeling were employed to analyze the differences and relationships.
Results indicate that, despite users’ initial preference for selecting chatbots, there are no differences in terms of knowledge learning performance and continuous usage intention between the search engine and the simple chatbot. Among the four tools for knowledge acquisition, the affective thought-guided chatbot achieves the best knowledge learning performance, and the thought-guided chatbot shows the lowest continuous usage intention. The mechanism test reveals that, compared to the search engine, the affective thought-guided chatbot increases users’ perceptions of all three aspects of transparency and cognitive effort. Whereas the thought-guided chatbot only increases perceived expressive transparency and cognitive effort. Furthermore, perceived expressive transparency and perceived diagnostic transparency improve knowledge learning performance, perceived social transparency and perceived diagnostic transparency promote continuous usage intention and cognitive effort enhances knowledge learning performance but weakens continuous usage intention.
This study contributes to the literature by concretizing coping theory in the chatbot context and dissecting interaction transparency into three nuanced aspects from a more detailed perspective. It addresses the ongoing debate over whether chatbots will replace search engines. It further introduces two innovative types of chatbots and presents a comprehensive framework to reveal the underlying mechanism.
