Humans are keen to exploit benevolent AI

Algorithm exploitation: Humans are keen to exploit benevolent AI:

  • People predict that AI agents will be as benevolent (cooperative) as humans
  • People cooperate less with benevolent AI agents than with benevolent humans
  • Reduced cooperation only occurs if it serves people’s selfish interests
  • People feel guilty when they exploit humans but not when they exploit AI agents

We cooperate with other people despite the risk of being exploited or hurt.
If future artificial intelligence (AI) systems are benevolent and cooperative toward us, what will we do in return? Our cooperative dispositions are weaker when we interact with AI.
Contrary to the hypothesis that people mistrust algorithms, participants trusted their AI partners to be as cooperative as humans. However, they did not return AI’s
benevolence as much and exploited the AI more than humans.
These findings warn that future self-driving cars or co-working robots, whose success depends on humans’ returning their cooperativeness, run the risk of being exploited. This vulnerability calls not just for smarter machines but also better human centered policies.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: