3rd International Conference on
Artificial Intelligence & Virtual Reality
December 14-18, 2020 (virtual/online event)
Current time CET:
| Monday, December 14 | Tuesday, December 15 | Wednesday, December 16 | Thursday, December 17 | Friday, December 18 | ||||||
| 1:30pm-3:30pm CET | Session 1a AI & VR (full, short papers) | Session 1b Workshop ImAna (1/2) | Session 4a Best paper session | Session 4b Workshop AIXR (1/2) | Session 7a VR focus (full, short papers) | Session 7b Workshop CRDH (1/2) | Session 10a AI focus (full, short papers, invited talk) | Session 10b Workshop MARCH (1/2) | Session 13a Industry (industry papers, invited talk) | Session 13b Workshop XRMI (1/2) |
| 3:45pm-5:15pm CET | Session 2 Keynote: Mark Billinghurst | Session 5 Keynote: Philipp Slusallek | Session 8 Keynote: Andrew Glassner | Session 11 Keynote: Jacki Morie | Session 14 Keynote: Victoria Interrante | |||||
| 5:30pm-7:30pm CET | Session 3a Special session: Avatars | Session 3b Workshop ImAna (2/2) | Session 6a Posters, demos | Session 6b Workshop AIXR (2/2) | Session 9a Posters, demos | Session 9b Workshop CRDH (2/2) | Session 12a Posters, demos | Session 12b Workshop MARCH (2/2) | Session 15a Special session: Gaming | Session 15b Workshop XRMI (2/2) |
Times are all CET (Central European Time). Click on the 'CET' link in the table to a pre-set time conversion site.
Chair: Jianquan Liu, technical support: Xiang Li
Using Semantic Segmentation to Assist the Creation of Interactive VR Applications (full paper) by Marcel Tiator, Anna Maria Kerkmann, Christian Geiger and Paul Grimm
Attention Estimation in Virtual Reality with EEG Based Image Regression (full paper) by Victor Delvigne, Hazem Wannous, Jean-Philippe Vandeborre, Laurence Ris and Thierry Dutoit
Interactive Design of Gallery Walls via Mixed Reality (full paper, special session) by Haikun Huang, Yuxuan Zhang, Tomer Weiss, Rebecca Perry and Lap-Fai Yu
Supporting Interaction in Augmented Reality Assisted Industrial Processes Using a CNN-Based Semantic Layer (full paper, special session) by Juan Jesus Izquierdo Domenech, Jordi Linares Pellicer and Jorge Orta Lopez
An Immersive Node-Link Visualization of Artificial Neural Networks for Machine Learning Experts (short paper) by Martin Bellgardt, Christian Scheiderer and Torsten Kuhlen
Featuring a keynote by Benjamin Bach, a panel with Benjamin Bach, Liz Marai, Luciana Nedel, and Yannick Prié, paper presentations and demos.
See program on the ImAna workshop page.
Chair: Jonathan Ventura, technical support: Yuzheng Chen
Conference opening (by general co-chair Wolfgang Hürst)
Keynote: "Using AR and VR for Next Generation Collaboration" by Mark Billinghurst
Abstract: In the current COVID climate tools for effective remote collaboration have become more important than ever before. The widespread use of video conferencing and other traditional desktop collaboration tools, has shown how limited they are compared to face to face collaboration. This presentation reviews research in Augmented Reality (AR) and Virtual Reality (VR) and shows how it can be used for next generation collaboration. In particular AR and VR can be used to re-introduce the spatial cues missing from desktop and mobile conferencing, and also makes it possible to communicate with rich non-verbal cues common in face to face conversation. In addition, AR/VR can be used to enable capabilities not available in face to face collaboration, such as being able to change body scale, share perspective, or having multiple people inhabit the same virtual body. The presentation will review this and also discuss research directions that could significantly improve collaboration in the future.
Program overview (by general co-chair Wolfgang Hürst)
Chair & session organizer: Mar Gonzalez Franco, technical support: Dominik Schön
Photorealistic avatars to enhance the efficacy of Self-attachment psychotherapy (full paper)
by Ibrahim Ghaznavi, Duncan Fyfe Gillies, Dasha Nicholls and Abbas Edalat
Verbal Mimicry Predicts Social Distance and Social Attraction to an Outgroup Member in Virtual Reality (short paper)
by Salvador Alvidrez and Jorge Pena
SnapMove: Movement Projection Mapping in Virtual Reality (full paper)
by Brian Cohn, Antonella Maselli, Eyal Ofek and Mar Gonzalez-Franco
Unmasking Communication Partners: A Low-Cost AI Solution for Digitally Removing Head-Mounted Displays in VR-Based Telepresence (full paper)
by Philipp Ladwig, Alexander Pech, Christian Geiger and Ralf Dörner
MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library (full paper)
by Mar Gonzalez-Franco, Zelia Egan, Matthew Peachey, Angus Antley, Tanmay Randhavane, Payod Panda, Yaying Zhang, Derek F. Reilly, Tabitha C Peck, Andrea Stevenson Won, Cheng Yao Wang, Anthony Steed and Eyal Ofek
Panel Panelists: Mar Gonzalez Franco (Microsoft Research) moderator, Domna Banakou (Universidad de Barcelona), Veronica Orvahlo (University Porto), Ye Pan (Disney Research), Nuria Pelechano (Universitat Politécnica de Catalunya)
Featuring a keynote by Benjamin Bach, a panel with Benjamin Bach, Liz Marai, Luciana Nedel, and Yannick Prié, paper presentations and demos.
See program on the ImAna workshop page.
Chair: Jason Orlosky, technical support: Tong Xue
Shooting Labels: 3D Semantic Labeling by Virtual Reality (full paper) by Pierluigi Zama Ramirez, Claudio Paternesi, Luca De Luigi, Luigi Lella, Daniele De Gregorio and Luigi Di Stefano
Learning Kinematic Machine Models from Videos (full paper) by Lucas Thies, Marc Stamminger and Frank Bauer
Towards Computer Aided Diagnosis of Autism Spectrum Disorder Using Virtual Environments (full paper) by Daniel Roth, Mathis Jording, Tobias Schmee, Peter Kullmann, Nassir Navab and Kai Vogeley
Exploring the Feasibility of Mitigating VR-HMD-Induced Cybersickness Using Cathodal Transcranial Direct Current Stimulation (full paper) by Gang Li, Mark McGill, Stephen Brewster, Frank Pollick, Francisco Macia Varela, Abdullah Habib and Qi Zhang
Featuring keynotes by Wijnand IJsselsteijn, Leon Kester, paper presentations, and workshop activities.
See program on the AIXR workshop page.
Chair: Zerrin Yumak, technical support: Xiaohang Tang
Conference statistics (by general co-chair Wolfgang Hürst)
Keynote: "Digital Reality: From AI to Synthetic Data and Back" by Philipp Slusallek
Abstract:
AI plays an increasingly important role in our daily lives, including making decision that potentially can harm humans, e.g. in autonomous driving. The ability of an AI system to reliably make accurate decision heavily depends on its ability to "understand" the world around it, even for situations that are highly complex or happen rarely. We propose Digital Reality as a concept that is closely related to AR/VR: We learn accurate (partial) models of the real world using AI in order to then identify and instantiate relevant scenarios (e.g. kid running in front of a car). From these scenarios we generate synthetic input data that can then be used for the training, benchmarking, as well as validation and certification of AI systems. We will discuss the the relationship to AR/VR as well as the specific requirements of this new area of research between graphics, AI, and high-performance computing.
Poster & demo teasers for next session
Chairs: Ivar Troost, Abdallah El Ali, technical support: Hidde Veer, Aakash Makhija, Mihail Tsakov, Teodor Nikolov, Jian-Wei Peng, Ting-Yang Kao
FaceAUG: A Cross-Platform Application for Real-Time Face Augmentation in Web Browser (demo) by Tianyue Ruby Sun
Virtual Reality Integrated Multi-depth-Camera-System for Real-Time Telepresence and Telemanipulation in Caregiving (demo) by Conrad Fifelski-von Böhlen, Anna Brinkmann, Stephan Mävers, Sandra Hellmers and Andreas Hein
Problems with Physical Simulation in a Virtual Lego-Based Assembly Task Using Unity3D Engine (demo) by Nor Farzana Syaza Jeffri and Dayang Rohaya Awang Rambli
A Smartphone Thermal Temperature Analysis for Virtual and Augmented Reality (poster) by Xiaoyang Zhang, Harshit Vadodaria, Na Li, Kyoung-Don Kang and Yao Liu
The Robot-Arm Talks Back to Me - Human Perception of Augmented Human-Robot Collaboration in Virtual Reality (poster) by Alexander Arntz, Sabrina Eimler and Ulrich Hoppe
Immersive Captioning: Developing a Framework for Evaluating User Needs (poster) by Chris Hughes, Marta Zapata, Matthew Johnston and Pilar Orero
Thermodynamics Reloaded: Experiencing Heating, Ventilation and Air Conditioning in AR (poster) by Alexander Arntz, Sabrina Eimler, Dustin Keßler, Aleksandra Nabokova and Sylvia Schädlich
Assessing the Effectiveness of Virtual Reality Gaming to Reduce Anxiety and Increase Cognitive Bandwidth (poster) by Daniel Hawes and Ali Arya
Immersive Virtual Reality Training for Inspecting Flagger Work Zones (poster) by Daeyeol Chang, James Hopfenblatt, Praveen Edara and Bimal Balakrishnan
Featuring keynotes by Wijnand IJsselsteijn, Leon Kester, paper presentations, and workshop activities.
See program on the AIXR workshop page.
Chair: Sebastian Günther, technical support: Calvin Ku
A Review of Electrostimulation-Based Cybersickness Mitigations (full paper) by Gang Li, Mark McGill, Stephen Brewster and Frank Pollick
The Efficacy of a Virtual Reality-Based Mindfulness Intervention (full paper) by Caglar Yildirim and Tara O'Grady
Under the (Plastic) Sea - Sensitizing People toward Ecological Behavior Using Virtual Reality Controlled by Users' Physical Activity (full paper) by Carolin Strassmann, Alexander Arntz and Sabrina C. Eimler
An AR Work Instructions Authoring Tool for Human-Operated Industrial Assembly Lines (full paper) by Traian Lavric, Emmanuel Bricard, Marius Preda and Titus Zaharia
Future Mobility Solutions: A Use Case for Understanding How VR Inhuences User Perception (short paper) by Onur Yildirim, Catlin Pidel and Mirjam West
Featuring keynotes by Wan-Chun Alex Ma and Gerard Pons-Moll and presentations by four invited speakers.
See program on the CRDH workshop page.
Chair: Min-Chun Hu, technical support: Yi-Yun Hsieh
Best paper awards
Keynote: "title TBD" by Andrew Glassner
Abstract:
TBD
Poster & demo teasers for next session
Chairs: Simon Dirks, Andrii Matviienko, technical support: Hidde Veer, Aakash Makhija, Mihail Tsakov, Teodor Nikolov, Jian-Wei Peng, Ting-Yang Kao
Story ARtist (demo) by Marie Kegeleers and Rafael Bidarra
Study on Pseudo-Haptics during Swimming Motion in a Virtual Reality Space (demo) by Hirooki Aoki
Extended Abstract: CoShopper - Leveraging Artificial Intelligence for an Enhanced Augmented (demo) by Yasmeen Alhamdan, Saif Alabachi and Naimul Khan
High-Quality First-Person Rendering Mixed Reality Gaming System for in Home Setting (poster) by Yu-Yen Chung, Hung-Jui Guo, Hiranya Garbha Kumar and Balakrishnan Prabhakaran
A QoE and Visual Attention Evaluation on the Inhuence of Spatial Audio in 360 Videos (poster) by Amit Hirway, Yuansong Qiao and Niall Murray
A Review of Deep Learning Approaches to EEG-Based Classification of Cybersickness in Virtual Reality (poster) by Caglar Yildirim
Workload, Presence and Task Performance of Virtual Object Manipulation on WebVR (poster) by Wenxin Sun, Mengjie Huang, Rui Yang, Jingjing Zhang, Liu Wang, Ji Han and Yong Yue
Rainbow Learner: Lighting Environment Estimation from a Structural-Color Based AR Marker (poster) by Yuji Tsukagoshi, Yuki Uranishi, Jason Orlosky, Kiyomi Ito and Haruo Takemura
Training with a World Champion: Augmented Reality Applications in Sport: Design-Led Research (poster) by Stefania Palmieri, Alessio Righi, Mario Bisson and Alessandro Ianniello
Featuring keynotes by Wan-Chun Alex Ma and Gerard Pons-Moll and presentations by four invited speakers.
See program on the CRDH workshop page.
Chair: Peter Kán, technical support: Kangyou Yu
Style-Transfer GANs for Bridging the Domain Gap in Synthetic Pose (full paper) by Pavel Rojtberg, Thomas Pöllabauer and Arjan Kuijper
Algorithm-Aware Neural Network Based Image Compression for High-Speed Imaging (short paper) by Reid Pinkham, Tanner Schmidt and Andrew Berkovich
Lane Line Map Estimation for Visual Alignment (short paper) by Minjung Son and Hyun Sung Chang
Social and Cognitive Modelling in Artificial Intelligence (invited talk) by Mehdi Dastani
Featuring a keynote by Rachel McDonnell, various paper presentations and invited talks.
See program on the MARCH workshop page.
Chair: Omar Niamut, technical support: Xiaoyue Ma
Conference announcements (by general co-chair Wolfgang Hürst)
Keynote: "Making Room for AI in XR: What to expect" by Jacquelyn Ford Morie
Abstract:
What will be the role of AI in our quickly evolving fields of XR? From smart NPCs to intelligent tutors for training, we can expect a wide range of AI applications to start populating our immersive creations. We should be considering both the benefits and the pitfalls we will encounter as they become commonplace.
Poster & demo teasers for next session
Chairs: Florian Müller, Kangsoo Kim, technical support: Hidde Veer, Aakash Makhija, Mihail Tsakov, Teodor Nikolov, Amber Elferink
Annotation Tool for Precise Emotion Ground Truth Label Acquisition While Watching 360-degree VR Videos (demo) by Tong Xue, Abdallah El Ali, Gangyi Ding and Pablo Cesar
3D Model Retrieval Using Constructive Solid Geometry in Virtual Reality (demo) by Samuel Börlin, Ralph Gasser, Florian Spiess and Heiko Schuldt
Implementations of the Gesture-Based Immersive Interaction and ML-Driven Sound Generation for Haptic Companion Doll (poster) by Jen Tun Lee, R.P.C. Janaka Rajapakse, Yi-Ping Hung and Miyata Kazunori
A Preliminary Investigation into a Deep Learning Implementation for Hand Tracking on Mobile Devices (poster) by Monica Gruosso, Nicola Capece, Ugo Erra and Francesco Angiolillo
Artificial Intelligence Assisted Virtual Reality Warfighter Training System (poster) by Aaron Gluck, Jessica Chen and Ratnadeep Paul
Investigating Learners' Motivation Towards a Virtual Reality Learning Environment: A Pilot Study in Vehicle Painting (poster) by Miriam Mulders
From Virtual Reality to Neuroscience and Back: A Use Case on Peripersonal Hand Space Plasticity (poster) by Agata Marta Soccini, Francesca Ferroni and Martina Ardizzi
Eye Tracking Data Collection Protocol for VR for Remotely Located Subjects Using Blockchain and Smart Contracts (poster) by Efe Bozkir, Shahram Eivazi, Mete Akgün and Enkelejda Kasneci
Featuring a keynote by Rachel McDonnell, various paper presentations and invited talks.
See program on the MARCH workshop page.
Chair: Vinoba Vinayagamoorthy, technical support: Guanghan Zhao
Juxtopia(R) CAMMRAD PREPARE: Wearable AI-AR Platform for Clinical Training Emergency First Response Teams (industry paper) by Jayfus Doswell, Justin Johnson and Marcus Messam
Mill Instructor: Teaching Industrial CNC Procedures Using Virtual Reality (industry paper) by Dustin Kessler, Alexander Arntz, Joachim Friedhoff and Sabrina Eimler
Interactive and Scalable Layout Synthesis with Design Templates (industry paper) by Hameedullah Farooki, Esra Cansizoglu, Jae-Woo Choi and Tomer Weiss
XR Use Cases for Training and Productivity (invited talk) by Saskia Groenewegen
Featuring keynotes by Ulrich Eck and Hoshang Kolivand plus various paper presentations.
See program on the XRMI workshop page.
Chair: Hai-Ning Liang, technical support: Shing-Ming Wong
Best presentation (poster/demo) award
Keynote: "Spatial Perception in Virtual Architectural Environments" by Victoria Interrante
Abstract:
Immersive Virtual Reality technology has transformative potential applications in architecture and design. In this talk I will review some of the work my lab has done to address fundamental challenges in effectively deploying VR technologies in architecture and design applications, focusing primarily on our investigations of factors influencing spatial perception accuracy in immersive architectural environments, but also touching on some examples of the use of VR technology to investigate other questions of interest to architectural and interior designers.
IEEE AIVR 2021 announcement and outlook (by general co-chair Wolfgang Hürst)
Chair & session organizer: Remco Veltkamp & Georgios N. Yannakakis, technical support: Nahal Norouzi
A serious VR game for acrophobia therapy in an urban environment (full paper)
by Costa Anton, Oana Mitrut, Jiri Kosinka, Alin Moldoveanu and Florica Moldoveanu
Exploring the possibilities of Extended Reality in the world of firefighting (full paper)
by Janne Heirman, Shivam Selleri, Tom De Vleeschauwer, Charles Hamesse, Michel Bellemans, Evarest Schoofs and Rob Haelterman
Inverse Kinematics and Temporal Convolutional Networks for Sequential Pose Analysis in VR (full paper)
by David Jeong, Jackie Xu and Lynn Miller
Invisible Dynamic Mechanic Adjustment in Virtual Reality Games (full paper)
by Justus Robertson, Rogelio E. Cardona-Rivera and R. Michael Young
Featuring keynotes by Ulrich Eck and Hoshang Kolivand plus various paper presentations.
See program on the XRMI workshop page.