A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital Experiences

Nikolaos Partarakis; Xenophon Zabulis

doi:10.3390/electronics13020269

journal article Open Access Jan 07, 2024

A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital Experiences

Nikolaos Partarakis

Xenophon Zabulis

Electronics Vol. 13 No. 2 pp. 269 · MDPI AG

View at Publisher Save 10.3390/electronics13020269

Abstract

The evolution of digital technologies has resulted in the emergence of diverse interaction technologies. In this paper, we conducted a review of seven domains under a human-centric approach user interface design, human-centered web-based information systems, semantic knowledge representation, X-reality applications, human motion and 3D digitization, serious games, and AI. In this review, we studied these domains concerning their impact on the way we interact with digital interfaces, process information, and engage in immersive experiences. As such, we highlighted the shifts in design paradigms, user-centered principles, and the rise of web-based information systems. The results of such shifts are materialized in modern immersive technologies, semantic knowledge representation, serious games, and the facilitation of artificial intelligence for interactions. Through this exploration, we aimed to assist our understanding of the challenges that lie ahead. The seamless integration of technologies, ethical considerations, accessibility, education for technological literacy, interoperability, user trust, environmental sustainability, and regulatory frameworks are becoming significant. These challenges present opportunities for the future to enrich human experiences while addressing societal needs. This paper lays the groundwork for thoughtful and innovative approaches to the challenges that will define the future of human–computer interaction and information technologies.

Topics

No keywords indexed for this article. Browse by subject →

References

220

[1]

Zhang "Microsoft Kinect sensor and its effect" IEEE Multimedia (2012) 10.1109/mmul.2012.24

[2]

Teixeira, A., Assena, A., Santos, A., Moura, M., Gomes, N., and Orvalho, J. (2014, January 17–19). Usability evaluation of playstation move motion controler. Proceedings of the International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing, Lisbon, Portugal.

[3]

A brief history of human-computer interaction technology

Brad A. Myers

Interactions 1998 10.1145/274430.274436

[4]

Jansen "The graphical user interface" ACM SIGCHI Bull. (1998) 10.1145/279044.279051

[5]

Campbell-Kelly, M., Aspray, W.F., Yost, J.R., Tinn, H., and Díaz, G.C. (2023). Computer: A History of the Information Machine, Taylor & Francis. 10.4324/9781003263272

[6]

Abras, C., Maloney-Krichmar, D., Preece, J., User-Centered Design, and Bainbridge, W. (2004). Encyclopedia of Human-Computer Interaction, Sage Publications.

[7]

Klaassen "User-centered evaluation of adaptive and adaptable systems: A literature review" Knowl. Eng. Rev. (2008) 10.1017/s0269888908001379

[8]

Doulgeraki "Adaptable Web-based user interfaces: Methodology and practice" eMinds Int. J. Hum. Comput. Interact. (2009)

[9]

Stephanidis, C., Akoumianakis, D., Sfyrakis, M., and Paramythis, A. (1998, January 19–21). Universal accessibility in HCI: Process-oriented design guidelines and tool requirements. Proceedings of the 4th ERCIM Workshop on User Interfaces for All, Stockholm, Sweden.

[10]

Saffer, D. (2008). Designing Gestural Interfaces: Touchscreens and Interactive Devices, O’Reilly Media, Inc.

[11]

Bhalla "Comparative study of various touchscreen technologies" Int. J. Comput. Appl. (2010)

[12]

Quesenbery, W. (2014). Content and Complexity, Routledge.

[13]

What is user engagement? A conceptual framework for defining user engagement with technology

Heather L. O'Brien, Elaine G. Toms

Journal of the American Society for Information Sc... 2008 10.1002/asi.20801

[14]

Isakowitz "Web information systems" Commun. ACM (1998) 10.1145/278476.278490

[15]

Seymour "History of search engines" Int. J. Manag. Inf. Syst. (IJMIS) (2011)

[16]

Schwartz "Web search engines" J. Am. Soc. Inf. Sci. (1998) 10.1002/(sici)1097-4571(1998)49:11<973::aid-asi3>3.0.co;2-z

[17]

Mylopoulos "An overview of knowledge representation" ACM SIGART Bulletin (1980)

[18]

Partarakis, N., Doulgeraki, V., Karuzaki, E., Galanakis, G., Zabulis, X., Meghini, C., Bartalesi, V., and Metilli, D. (2022). A Web-Based Platform for Traditional Craft Documentation. Multimodal Technol. Interact., 6. 10.3390/mti6050037

[19]

Healy, K. (2018). Data Visualization: A Practical Introduction, Princeton University Press.

[20]

Mughal "Data mining: Web data mining techniques, tools and algorithms: An overview" Int. J. Adv. Comput. Sci. Appl. (2018)

[21]

Kobayashi "Information retrieval on the web" ACM Comput. Surv. (CSUR) (2000) 10.1145/358923.358934

[22]

Hendler "The semantic web" Sci. Am. (2001) 10.1038/scientificamerican0501-34

[23]

Domingue, J., Fensel, D., and Hendler, J.A. (2011). Handbook of Semantic Web Technologies, Springer. 10.1007/978-3-540-92913-0

[24]

Bonatti, P.A., Decker, S., Polleres, A., and Presutti, V. (2019). Dagstuhl Reports, Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.

[25]

Uschold "Where are the semantics in the semantic web?" AI Mag. (2003)

[26]

Breitman, K.K., Casanova, M.A., and Truszkowski, W. (2007). Semantic Web: Concepts, Technologies and Applications, Springer.

[27]

The state of immersive technology research: A literature analysis

Ayoung Suh, Jane Prophet

Computers in Human Behavior 2018 10.1016/j.chb.2018.04.019

[28]

Handa "Immersive technology–uses, challenges and opportunities" Int. J. Comput. Bus. Res. (2012)

[29]

A Survey of Augmented Reality

Ronald T. Azuma

Presence: Teleoperators and Virtual Environments 1997 10.1162/pres.1997.6.4.355

[30]

Virtual Reality Technology

Grigore Burdea, Philippe Coiffet

Presence: Teleoperators and Virtual Environments 10.1162/105474603322955950

[31]

Speicher, M., Hall, B.D., and Nebeling, M. (2019, January 4–9). What is mixed reality?. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK. 10.1145/3290605.3300767

[32]

Doolani, S., Wessels, C., Kanal, V., Sevastopoulos, C., Jaiswal, A., Nambiappan, H., and Makedon, F. (2020). A review of extended reality (xr) technologies for manufacturing training. Technologies, 8. 10.3390/technologies8040077

[33]

Ringas "Traditional Craft Training and Demonstration in Museums" Heritage (2022) 10.3390/heritage5010025

[34]

Hauser "Multimodal narratives for the presentation of silk heritage in the museum" Heritage (2022) 10.3390/heritage5010027

[35]

A Survey of Computer Vision-Based Human Motion Capture

Thomas B. Moeslund, Erik Granum

Computer Vision and Image Understanding 2001 10.1006/cviu.2000.0897

[36]

Moeslund "A survey of advances in vision-based human motion capture and analysis" Comput. Vis. Image Underst. (2006) 10.1016/j.cviu.2006.08.002

[37]

Geiger, A., Ziegler, J., and Stiller, C. (2011, January 5–9). Stereoscan: Dense 3d reconstruction in real-time. Proceedings of the 2011 IEEE Intelligent Vehicles Symposium (IV), IEEE, Baden-Baden, Germany. 10.1109/ivs.2011.5940405

[38]

Kang, Z., Yang, J., Yang, Z., and Cheng, S. (2020). A review of techniques for 3d reconstruction of indoor environments. ISPRS Int. J. Geo-Inf., 9. 10.3390/ijgi9050330

[39]

Stotko "State of the art on 3D reconstruction with RGB-D cameras" Comput. Graph. Forum (2018) 10.1111/cgf.13386

[40]

Pollefeys "Detailed real-time urban 3d reconstruction from video" Int. J. Comput. Vis. (2008) 10.1007/s11263-007-0086-4

[41]

Hasan "Augmented reality and digital twin system for interaction with construction machinery" J. Asian Archit. Build. Eng. (2022) 10.1080/13467581.2020.1869557

[42]

Ma "Digital twin enhanced human-machine interaction in product lifecycle" Procedia Cirp. (2019) 10.1016/j.procir.2019.04.330

[43]

Onaji "Digital twin in manufacturing: Conceptual framework and case studies" Int. J. Comput. Integr. Manuf. (2022) 10.1080/0951192x.2022.2027014

[44]

Boschert, S., and Rosen, R. (2016). Mechatronic Futures: Challenges and Solutions for Mechatronic Systems and Their Designers, Springer.

[45]

Susi, T., Johannesson, M., and Backlund, P. (2007). Serious Games: An Overview, School of Humanities and Informatics, University of Skövde.

[46]

Connolly "A systematic literature review of empirical evidence on computer games and serious games" Comput. Educ. (2012) 10.1016/j.compedu.2012.03.004

[47]

Planas "Towards a model-driven approach for multiexperience AI-based user interfaces" Softw. Syst. Model. (2021) 10.1007/s10270-021-00904-y

[48]

Sousa, R., Miranda, R., Moreira, A., Alves, C., Lori, N., and Machado, J. (2021). Software tools for conducting real-time information processing and visualization in industry: An up-to-date review. Appl. Sci., 11. 10.3390/app11114800

[49]

Escotet, M.Á. (2023). The optimistic future of Artificial Intelligence in higher education. Prospects, 1–10. 10.1007/s11125-023-09642-z

[50]

The forthcoming Artificial Intelligence (AI) revolution: Its impact on society and firms

Spyros Makridakis

Futures 2017 10.1016/j.futures.2017.03.006

Showing 50 of 220 references

Cited By

81

Advancing Sustainable Building Construction Through Immersive Digital Technologies: Towards Digital Transformation in the Nigerian Context

Oluwagbemiga Paul Agboola, Abdulaziz Mislat Alsharif · 2026

Buildings

Overview of AI and communication for 6G network: fundamentals, challenges, and future research opportunities

Qimei Cui, Xiaohu You · 2025

Science China Information Sciences

Metrics

81

Citations

220

References

Details

Published: Jan 07, 2024
Vol/Issue: 13(2)
Pages: 269
License: View

Authors

N

Nikolaos Partarakis

Institute of Computer Science, Foundation for Research and Technology Hellas, N. Plastira 100, Vassilika Vouton, GR-70013 Heraklion, Crete, Greece

X

Xenophon Zabulis

Institute of Computer Science, Foundation for Research and Technology Hellas, N. Plastira 100, Vassilika Vouton, GR-70013 Heraklion, Crete, Greece

Funding

European Union’s Horizon Europe Research and Innovation Program Award: 101094349

Cite This Article

Nikolaos Partarakis, Xenophon Zabulis (2024). A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital Experiences. Electronics, 13(2), 269. https://doi.org/10.3390/electronics13020269

A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital Experiences

You May Also Like