This is the third in our four-part series on the future of character AI. Parts 1 and 4 are co-written with Werner Schirmer. See here for posts #1, #2 and #4.
Introduction
The previous post in this series discussed the notion of believability. An NPC is believable if it behaves and interacts with players in ways that align with their innate and acquired psychological expectations about agent behavior. Believable NPCs feel as if they're alive - even if the player knows that that's not true.
(Image: a clip from our upcoming mobile cat game. All character movement is procedurally synthesized. Ball and virtual hand are moved by touch input.)
Over the past year I've had the chance to talk to dozens of players and industry professionals about the topics covered in this series, and I've observed the same pattern over and over again:
Players have been sympathetic, and frequently enthusiastic about what we do. When we showed them the game we're working on, most of them immediately 'got' that better artificial behavior could make virtual pets much more endearing and fun.
About 1/3 of professionals, on the other hand, were less convinced, especially if they were men and had spent 2+ decades in the industry. E.g., people who had worked on games such as The Sims (2000) told me they had learned there that players "don't need" believable NPCs as long as the gameplay is engaging.
I still find this last argument quite puzzling. To me it's like saying we "don't need" 3D games because players loved Super Mario Bros. But Virtual Beings is a research spin-off, and so I decided to investigate the issue. This post provides the results, showing clear evidence that ...
... players want better NPCs (part 1),
... games researchers have known this for a while (part 2), and
... there are psychological reasons why people find it deeply unpleasant to interact with non-believable NPCs (part 3).
1. Players want better NPCs
When a lot of people are annoyed by something, they tend to be vocal about it on the internet. Bad NPCs should be no exception, and I therefore decided to search through the obvious places: Reddit, YouTube and so on.
They want them on Reddit
Reddit is undoubtedly the main site where gamers share opinions on the things they care about. In order to get a sense of their views on today's NPCs, I searched systematically for positive and negative threads on game AI. To find positive ones, I used Google with keywords 'good OR great game ai site:reddit.com' (without quotes), for negative ones 'bad game ai site:reddit.com'. I limited myself to the first 15 pages of results, and excluded all irrelevant hits as well as hits for genres such as strategy, racing, sports or boardgames (where game AI is mostly about strategic gameplay and NPCs are either absent or highly scripted).
The results are striking. Not only are there fewer positive results, they also produce far less engagement than the negative ones. This is despite the fact that positive information generally spreads faster than negative on social media.
Looking at the actual content of the positive threads and most upvoted comments, I was astonished to find that about 75% of the engagement focused on praising the NPCs in a handful of very old games, especially F.E.A.R. (2005) and Black & White (2001).
The negative threads went in a similar direction, with countless complaints that NPCs haven't really progressed since F.E.A.R (2005).
In sum, players on Reddit feel that 15-year old games got their NPCs right (for the time being), and that there's been no real progress since.
They want them on YouTube
I found a similar picture on YouTube, the largest aggregator of non-live gameplay videos and commentary. It hosts a myriad of videos about bad NPC AI, falling into two broad categories.
AI rants. These provide direct criticism and analysis, often venting frustration or giving concrete feedback to developers. Such videos are not simply a niche phenomenon, as it's easy to verify that their total views are in the 100s of millions.
AI fail compilations. These generally adopt a humorous tone, and usually they're meant to entertain. They are far more popular than rants, with some of them getting viewership in the tens of millions. Total views are in the billions.
They want them on Twitter
In recent years, Twitter has become the primary site of constructive dialogue between players and developers. It is therefore the go-to place where players demand better, friendlier, more interactive and more 'wholesome' NPCs. Probably the best examples are 'Can You Pet The Dog?' and the developer-oriented 'Wholesome Games', which are both heavily invested in games with such NPCs.
The gaming press wants them as well
Finally, it's worth mentioning that the gaming press continues to publish enthusiastic articles which promise us that better AI (and notably NPC AI) will "revolutionize" gaming at some point. This is in part driven by the last decade's advances in machine learning, which are transforming entire industries but (for reasons we'll cover in a future post) haven't had a noticeable impact on the quality of NPCs in today's games.
2. Games researchers have known for years that many players want better NPCs
Games and media researchers have investigated the relationships between players and NPCs for years. An early warning call came from a highly influential 2006 paper by Hartmann & Klimmt). They asked female players what they did not enjoy in video games.
By far the most prominent answer (with an importance-score of 59.14%) was: "lack of opportunities for meaningful social interaction in single-player mode". It's been fifteen years since the paper came out, and it seems safe to say that meaningful social interactions with NPCs are still as rare as they were then.
A representative study of players in Finland and Denmark was published in a 2017 paper by Vahlo and colleagues. They found that 8.0% of the playing population are primarily motivated by empathic interactions with NPCs. Transposed to a global level, with a total population of 2.7 billion gamers in 2020, this already corresponds to 216 million underserved players.
