AI can distort human beliefs

Without a zone of uncertainty plus other troubling features, generative AI is poised to amplify bias and falsehoods, distort human perception.

Individual humans form their beliefs by sampling a small subset of the available data in the world. Once those beliefs are formed with high certainty, they can become stubborn to revise. Fabrication and bias in generative artificial intelligence (AI) models are established phenomena that can occur as part of regular system use, in the absence of any malevolent forces seeking to push bias or disinformation. However, transmission of false information and bias from these models to people has been prominently absent from the discourse. Overhyped, unrealistic, and exaggerated capabilities permeate how generative AI models are presented, which contributes to the popular misconception that these models exceed human-level reasoning and exacerbates the risk of transmission of false information and negative stereotypes to people.

people regularly communicate uncertainty through phrases such as “I think,” response delays, corrections, and speech disfluencies.
By contrast, generative models unilaterally generate confident, fluent responses with no uncertainty representations nor the ability to communicate their absence.

“This lack of uncertainty signals in generative models could cause greater distortion compared with human inputs.”

Generative AI models have the potential to further amplify the repeated exposure issues for both fabrications and bias because of their expected influence on contents of the World Wide Web—a primary source of training data for the models. 


Resources are needed for the education of the public, policy-makers, and interdisciplinary scientists to give realistically informed views of how generative AI models work and to correct existing misinformation and hype surrounding these new technologies.
Collaborative action requires teaching everyone how to discriminate actual from imagined capabilities of new technologies to focus on tackling real, concrete challenges together.

Leave a comment