Bot or not? User Perceptions of Player Substitution with Deep Player Behavior Models

Pfau, J; Smeddinck, JD; Bikas, I; Malaka, R

doi:10.1145/3313831.3376223

Bot or not? User Perceptions of Player Substitution with Deep Player Behavior Models

Lookup NU author(s): Dr Jan Smeddinck ORCiD

Downloads

Accepted version [.pdf]

Licence

This is the authors' accepted manuscript of a conference proceedings (inc. abstract) that has been published in its final definitive form by Association for Computing Machinery, 2020.

For re-use rights please refer to the publisher's terms and conditions.

Abstract

Many online games suffer when players drop off due to lost connections or quitting prematurely, which leads to match terminations or game-play imbalances. While rule-based outcome evaluations or substitutions with bots are frequently used to mitigate such disruptions, these techniques are often perceived as unsatisfactory. Deep learning methods have successfully been used in deep player behavior modelling (DPBM) to produce non-player characters or bots which show more complex behavior patterns than those modelled using traditional AI techniques. Motivated by these findings, we present an investigation of the player-perceived awareness, believability and representativeness, when substituting disconnected players with DPBM agents in an online-multiplayer action game. Both quantitative and qualitative outcomes indicate that DPBM agent substitutes perform similarly to human players and that players were unable to detect substitutions. Notably, players were in fact able to detect substitution with agents driven by more traditional heuristics.