journal article
Oct 05, 2021
Increasing Player Performance and Game Experience in High Latency Systems
Proceedings of the ACM on Human-Computer Interaction
Vol. 5
No. CHI PLAY
pp. 1-20
·
Association for Computing Machinery (ACM)
Abstract
Cloud gaming services and remote play offer a wide range of advantages but can inherent a considerable delay between input and action also known as latency. Previous work indicates that deep learning algorithms such as artificial neural networks (ANN) are able to compensate for latency. As high latency in video games significantly reduces player performance and game experience, this work investigates if latency can be compensated using ANNs within a live first-person action game. We developed a 3D video game and coupled it with the prediction of an ANN. We trained our network on data of 24 participants who played the game in a first study. We evaluated our system in a second user study with 96 participants. To simulate latency in cloud game streaming services, we added 180 ms latency to the game by buffering user inputs. In the study we predicted latency values of 60 ms, 120 ms and 180 ms. Our results show that players achieve significantly higher scores, substantially more hits per shot and associate the game significantly stronger with a positive affect when supported by our ANN. This work illustrates that high latency systems, such as game streaming services, benefit from utilizing a predictive system.
Topics
No keywords indexed for this article. Browse by subject →
References
51
[1]
Mart'in Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Mané Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Viégas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://doi.org/10.5555/3026877.3026899 Software available from tensorflow.org.
10.5555/3026877.3026899
[5]
Yahn W Bernier. 2001. Latency compensating methods in client/server in-game protocol design and optimization. In Game Developers Conference, Vol. 98033.
[6]
BLADE. 2020. Shadow - Verwandle deine Geräte in einen Gaming PC. https://shadow.tech/. Accessed on 2020-08--23.
[9]
Video Games Chronicle. 2020. Warcraft 3: Reforged is now the worst user scored game ever on Metacritic. https://www.videogameschronicle.com/news/warcraft-3-reforged-is-now-the-worst-user-scored-game-ever-on-metacritic/. Accessed on 2021-07-05.
[14]
EarlyGame. 2020. Remote esports -- is it sustainable? https://www.earlygame.com/remote-esports-is-it-sustainable/. Accessed on 2021-07-05.
[16]
Eurogamer. 2020. Doom Eternal on Stadia looks great - but the lag is just too high. https://www.eurogamer.net/articles/digitalfoundry-2020-doom-eternal-stadia-looks-the-part-but-lag-is-too-high . Accessed on 2020-08--21.
[17]
[18]
Forbes. 2019. Why 'Anthem' Failed And Why It Was Never Destined To Succeed. https://www.forbes.com/sites/erikkain/2019/05/30/why-anthem-failed-and-why-it-was-never-destined-to-succeed/. Accessed on 2021-07-05.
[19]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In Proceedings of the fourteenth international conference on artificial intelligence and statistics . 315--323.
[20]
Google. 2020. Stadia - Game Streaming. https://stadia.google.com/. Accessed on 2020-08--23.
[22]
Wijnand A IJsselsteijn, Yvonne AW de Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013), 3--9.
[26]
Taekhyun Kim, Swagat Mohapatra, Mukta Gore, and Alok Ahuja. 2014. Latency reduction by sub-frame encoding and transmission. US Patent App. 13/728,296.
[27]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[28]
Kotaku. 2019. Bug-Riddled Update Shows Why Fallout 76 Needs A Public Test Server. https://kotaku.com/bug-riddled-update-shows-why-fallout-76-needs-a-public-1836457946 . Accessed on 2021-07-05.
[37]
PCGamer. 2019. Here's how Stadia's input lag compares to native PC gaming. https://www.pcgamer.com/heres-how-stadias-input-lag-compares-to-native-pc-gaming/. Accessed on 2020-08--21.
[39]
Razer. 2021 a. RAZER DEATHADDER V2 PRO. https://www2.razer.com/eu-en/store/razer-deathadder-v2-pro . Accessed on 2021-07-05.
[40]
Razer. 2021 b. RAZER HUNTSMAN V2 ANALOG - US. https://www2.razer.com/eu-en/store/razer-huntsman-v2-analog/. Accessed on 2021-07-05.
[43]
Daniel Smilkov, Nikhil Thorat, Yannick Assogba, Ann Yuan, Nick Kreeger, Ping Yu, Kangyi Zhang, Shanqing Cai, Eric Nielsen, David Soergel, et almbox. 2019. Tensorflow. js: Machine learning for the web and beyond. arXiv preprint arXiv:1901.05350 (2019).
[44]
Josef Spjut. 2021. A Case Study of First Person Aiming at Low Latency for Esports. (2021).
10.31219/osf.io/nu9p3
[45]
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research , Vol. 15, 1 (2014), 1929--1958.
[46]
Statista. 2021. DOTA 2 The International championships prize pool from 2011 to 2019. https://www.statista.com/statistics/749033/dota-2-championships-prize-pool/. Accessed on 2021-07-05.
[47]
Jiawei Sun and Mark Claypool. 2019. Evaluating Streaming and Latency Compensation in a Cloud-based Game. In Proceedings of the 15th IARIA Advanced International Conference on Telecommunications (AICT) .
[48]
Wendell Sun. 2019. Adaptive bitrate streaming latency reduction. US Patent 10,432,982.
[49]
TensorFlow. 2015. TensorFlow. https://www.tensorflow.org/tutorials/structured_data/time_series . Accessed on 2020--10--21.
[50]
PCMag UK. 2015. OnLive Streaming Service Shutting Down at End of April. https://uk.pcmag.com/gaming-systems/40903/onlive-streaming-service-shutting-down-at-end . Accessed on 2021-04--28.
Showing 50 of 51 references
Cited By
18
Embedded System for Interactive Pneumatic Hand Rehabilitation: Real-Time Gaming Interface With Cognitive Stimulation for Motor Recovery
IEEE Access
Narges Ghobadi, Witold Kinsner · 2025
Metrics
18
Citations
51
References
Details
- Published
- Oct 05, 2021
- Vol/Issue
- 5(CHI PLAY)
- Pages
- 1-20
- License
- View
Authors
Cite This Article
David Halbhuber, Niels Henze, Valentin Schwind (2021). Increasing Player Performance and Game Experience in High Latency Systems. Proceedings of the ACM on Human-Computer Interaction, 5(CHI PLAY), 1-20. https://doi.org/10.1145/3474710
Related
You May Also Like
Reliability and Inter-rater Reliability in Qualitative Research
Nora McDonald, Sarita Schoenebeck · 2019
889 citations
Deconstructing Community-Based Collaborative Design
Christina Harrington, Sheena Erete · 2019
470 citations
"Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making
Carrie J. Cai, Samantha Winter · 2019
424 citations