Exploring excitement counterbalanced by concerns towards AI technology using a descriptive-prescriptive data processing method

Abstract

AbstractGiven the current pace of technological advancement and its pervasive impact on society, understanding public sentiment is essential. The usage of AI in social media, facial recognition, and driverless cars has been scrutinized using the data collected by a complex survey. To extract insights from data, a descriptive-prescriptive hybrid data processing method is proposed. It includes graphical visualization, cross-tabulation to identify patterns and correlations, clustering using K-means, principal component analysis (PCA) enabling 3D cluster representation, analysis of variance (ANOVA) of clusters, and forecasting potential leveraged by Random Forest to predict clusters. Three well-separated clusters with a silhouette score of 0.828 provide the profile of the respondents. The affiliation of a respondent to a particular cluster is assessed by an F1 score of 0.99 for the test set and 0.98 for the out-of-sample set. With over 5000 respondents answering over 120 questions, the dataset reveals interesting opinions and concerns regarding AI technologies that have to be handled to facilitate AI acceptance and adoption. Its findings have the potential to shape meaningful dialog and policy, ensuring that the evolution of technology aligns with the values and needs of the people.