A Multifaceted Approach at Discerning Redditors Feelings Towards ChatGPT

Title

A Multifaceted Approach at Discerning Redditors Feelings Towards ChatGPT

Creator

Padarha S.; Vijaylakshmi S.

Description

Generative AI platforms like ChatGPT have leapfrogged in terms of technological advancements. Traditional methods of scrutiny are not enough for assessing their technological efficacy. Understanding public sentiment and feelings towards ChatGPT is crucial for pre-empting the technologys longevity and impact while also providing a silhouette of human psychology. Social media platforms have seen tremendous growth in recent years, resulting in a surge of user-generated content. Among these platforms, Reddit stands out as a forum for users to engage in discussions on various topics, including Generative Artificial Intelligence (GAI) and chatbots. Traditional pedagogy for social media sentiment analysis and opinion mining are time consuming and resource heavy, while lacking representation. This paper provides a novice multifrontal approach that utilises and integrates various techniques for better results. The data collection and preparation are done through the Reddit API in tandem with multi-stage weighted and stratified sampling. NLP (Natural Language processing) techniques encompassing LDA (Latent Dirichlet Allocation), Topic modelling, STM (Structured Topic Modelling), sentiment analysis and emotional analysis using RoBERTa are deployed for opinion mining. To verify, substantiate and scrutinise all variables in the dataset, multiple hypothesises are tested using ANOVA, T-tests, KruskalWallis test, Chi-Square Test and MannWhitney U test. The study provides a novel contribution to the growing literature on social media sentiment analysis and has significant new implications for discerning user experience and engagement with AI chatbots like ChatGPT. 2024 Padarha et al., licensed to EAI.

Source

EAI Endorsed Transactions on Internet of Things, Vol-10

Date

2024-01-01

Publisher

European Alliance for Innovation

Subject

Generative AI; Multi-Stage Sampling; Multiple Hypothesis Testing; Opinion Mining; Topic Modelling

Coverage

Padarha S., CHRIST (Deemed to be University), Pune, Lavas, India; Vijaylakshmi S., CHRIST (Deemed to be University), Pune, Lavas, India

Rights

All Open Access; Gold Open Access

Relation

ISSN: 24141399

Format

Online

Language

English

Type

Article

Identifier

https://doi.org/10.4108/eetiot.6447

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85197709710&doi=10.4108%2feetiot.6447&partnerID=40&md5=05aefc77442a184f9044840dc80bb0e8