AIVR 2020)

3rd International Conference on

Artificial Intelligence & Virtual Reality

December 14-18, 2020 (virtual/online event)
Welcome
History Important dates

Program at a glance

Current time CET:


Monday, December 14 Tuesday, December 15 Wednesday, December 16 Thursday, December 17 Friday, December 18
1:30pm-3:30pm CET Session 1a
AI & VR (full, short papers)
Session 1b
Workshop ImAna (1/2)
Session 4a
Best paper session
Session 4b
Workshop AIXR (1/2)
Session 7a
VR focus (full, short papers)
Session 7b
Workshop CRDH (1/2)
Session 10a
AI focus (full, short papers, invited talk)
Session 10b
Workshop MARCH (1/2)
Session 13a
Industry (industry papers, invited talk)
Session 13b
Workshop XRMI (1/2)
3:45pm-5:15pm CET Session 2
Keynote: Mark Billinghurst
Session 5
Keynote: Philipp Slusallek
Session 8
Keynote: Andrew Glassner
Session 11
Keynote: Jacki Morie
Session 14
Keynote: Victoria Interrante
5:30pm-7:30pm CET Session 3a
Special session: Avatars
Session 3b
Workshop ImAna (2/2)
Session 6a
Posters, demos
Session 6b
Workshop AIXR (2/2)
Session 9a
Posters, demos
Session 9b
Workshop CRDH (2/2)
Session 12a
Posters, demos
Session 12b
Workshop MARCH (2/2)
Session 15a
Special session: Gaming
Session 15b
Workshop XRMI (2/2)

Times are all CET (Central European Time). Click on the 'CET' link in the table to a pre-set time conversion site.


Detailed program


Monday, December 14, 2020


Session 1a: AI & VR (full and short papers)

Chair: Jianquan Liu, technical support: Xiang Li

Using Semantic Segmentation to Assist the Creation of Interactive VR Applications (full paper)
by Marcel Tiator, Anna Maria Kerkmann, Christian Geiger and Paul Grimm

Attention Estimation in Virtual Reality with EEG Based Image Regression (full paper)
by Victor Delvigne, Hazem Wannous, Jean-Philippe Vandeborre, Laurence Ris and Thierry Dutoit

Interactive Design of Gallery Walls via Mixed Reality (full paper, special session)
by Haikun Huang, Yuxuan Zhang, Tomer Weiss, Rebecca Perry and Lap-Fai Yu

Supporting Interaction in Augmented Reality Assisted Industrial Processes Using a CNN-Based Semantic Layer (full paper, special session)
by Juan Jesus Izquierdo Domenech, Jordi Linares Pellicer and Jorge Orta Lopez

An Immersive Node-Link Visualization of Artificial Neural Networks for Machine Learning Experts (short paper)
by Martin Bellgardt, Christian Scheiderer and Torsten Kuhlen

Session 1b: Workshop on Immersive Analytics (ImAna), part 1

Featuring a keynote by Benjamin Bach, a panel with Benjamin Bach, Liz Marai, Luciana Nedel, and Yannick Prié, paper presentations and demos.

   

See program on the ImAna workshop page.

 

Session 2: Opening & keynote

Chair: Jonathan Ventura, technical support: Yuzheng Chen

Conference opening (by general co-chair Wolfgang Hürst)

Keynote: "Using AR and VR for Next Generation Collaboration" by Mark Billinghurst
Abstract: In the current COVID climate tools for effective remote collaboration have become more important than ever before. The widespread use of video conferencing and other traditional desktop collaboration tools, has shown how limited they are compared to face to face collaboration. This presentation reviews research in Augmented Reality (AR) and Virtual Reality (VR) and shows how it can be used for next generation collaboration. In particular AR and VR can be used to re-introduce the spatial cues missing from desktop and mobile conferencing, and also makes it possible to communicate with rich non-verbal cues common in face to face conversation. In addition, AR/VR can be used to enable capabilities not available in face to face collaboration, such as being able to change body scale, share perspective, or having multiple people inhabit the same virtual body. The presentation will review this and also discuss research directions that could significantly improve collaboration in the future.

Program overview (by general co-chair Wolfgang Hürst)

 

Session 3a: Special session on "Avatars for AI & VR"

Chair & session organizer: Mar Gonzalez Franco, technical support: Dominik Schön

Photorealistic avatars to enhance the efficacy of Self-attachment psychotherapy (full paper)
by Ibrahim Ghaznavi, Duncan Fyfe Gillies, Dasha Nicholls and Abbas Edalat

Verbal Mimicry Predicts Social Distance and Social Attraction to an Outgroup Member in Virtual Reality (short paper)
by Salvador Alvidrez and Jorge Pena

SnapMove: Movement Projection Mapping in Virtual Reality (full paper)
by Brian Cohn, Antonella Maselli, Eyal Ofek and Mar Gonzalez-Franco

Unmasking Communication Partners: A Low-Cost AI Solution for Digitally Removing Head-Mounted Displays in VR-Based Telepresence (full paper)
by Philipp Ladwig, Alexander Pech, Christian Geiger and Ralf Dörner

MoveBox: Democratizing MoCap for the Microsoft Rocketbox Avatar Library (full paper)
by Mar Gonzalez-Franco, Zelia Egan, Matthew Peachey, Angus Antley, Tanmay Randhavane, Payod Panda, Yaying Zhang, Derek F. Reilly, Tabitha C Peck, Andrea Stevenson Won, Cheng Yao Wang, Anthony Steed and Eyal Ofek

Panel
Panelists: Mar Gonzalez Franco (Microsoft Research) moderator, Domna Banakou (Universidad de Barcelona), Veronica Orvahlo (University Porto), Ye Pan (Disney Research), Nuria Pelechano (Universitat PolitÚcnica de Catalunya)

Session 3b: Workshop on Immersive Analytics (ImAna), part 2
See program on the ImAna workshop page.

Featuring a keynote by Benjamin Bach, a panel with Benjamin Bach, Liz Marai, Luciana Nedel, and Yannick Prié, paper presentations and demos.

   

See program on the ImAna workshop page.


Tuesday, December 15, 2020


Session 4a: Best paper session

Chair: Jason Orlosky, technical support: Tong Xue

Shooting Labels: 3D Semantic Labeling by Virtual Reality (full paper)
by Pierluigi Zama Ramirez, Claudio Paternesi, Luca De Luigi, Luigi Lella, Daniele De Gregorio and Luigi Di Stefano

Learning Kinematic Machine Models from Videos (full paper)
by Lucas Thies, Marc Stamminger and Frank Bauer

Towards Computer Aided Diagnosis of Autism Spectrum Disorder Using Virtual Environments (full paper)
by Daniel Roth, Mathis Jording, Tobias Schmee, Peter Kullmann, Nassir Navab and Kai Vogeley

Exploring the Feasibility of Mitigating VR-HMD-Induced Cybersickness Using Cathodal Transcranial Direct Current Stimulation (full paper)
by Gang Li, Mark McGill, Stephen Brewster, Frank Pollick, Francisco Macia Varela, Abdullah Habib and Qi Zhang

Session 4b: Workshop on Ethics in AI & XR (AIXR), part 1

Featuring keynotes by Wijnand IJsselsteijn, Leon Kester, paper presentations, and workshop activities.

 

See program on the AIXR workshop page.

 

Session 5: Keynote & poster teasers

Chair: Zerrin Yumak, technical support: Xiaohang Tang

Conference statistics (by general co-chair Wolfgang Hürst)

Keynote: "Digital Reality: From AI to Synthetic Data and Back" by Philipp Slusallek
Abstract: AI plays an increasingly important role in our daily lives, including making decision that potentially can harm humans, e.g. in autonomous driving. The ability of an AI system to reliably make accurate decision heavily depends on its ability to "understand" the world around it, even for situations that are highly complex or happen rarely. We propose Digital Reality as a concept that is closely related to AR/VR: We learn accurate (partial) models of the real world using AI in order to then identify and instantiate relevant scenarios (e.g. kid running in front of a car). From these scenarios we generate synthetic input data that can then be used for the training, benchmarking, as well as validation and certification of AI systems. We will discuss the the relationship to AR/VR as well as the specific requirements of this new area of research between graphics, AI, and high-performance computing.

Poster & demo teasers for next session

 

Session 6a: Posters & demos

Chairs: Ivar Troost, Abdallah El Ali, technical support: Hidde Veer, Aakash Makhija, Mihail Tsakov, Teodor Nikolov, Jian-Wei Peng, Ting-Yang Kao

FaceAUG: A Cross-Platform Application for Real-Time Face Augmentation in Web Browser (demo) by Tianyue Ruby Sun

Virtual Reality Integrated Multi-depth-Camera-System for Real-Time Telepresence and Telemanipulation in Caregiving (demo) by Conrad Fifelski-von Böhlen, Anna Brinkmann, Stephan Mńvers, Sandra Hellmers and Andreas Hein

Problems with Physical Simulation in a Virtual Lego-Based Assembly Task Using Unity3D Engine (demo) by Nor Farzana Syaza Jeffri and Dayang Rohaya Awang Rambli

A Smartphone Thermal Temperature Analysis for Virtual and Augmented Reality (poster) by Xiaoyang Zhang, Harshit Vadodaria, Na Li, Kyoung-Don Kang and Yao Liu

The Robot-Arm Talks Back to Me - Human Perception of Augmented Human-Robot Collaboration in Virtual Reality (poster) by Alexander Arntz, Sabrina Eimler and Ulrich Hoppe

Immersive Captioning: Developing a Framework for Evaluating User Needs (poster) by Chris Hughes, Marta Zapata, Matthew Johnston and Pilar Orero

Thermodynamics Reloaded: Experiencing Heating, Ventilation and Air Conditioning in AR (poster) by Alexander Arntz, Sabrina Eimler, Dustin Ke▀ler, Aleksandra Nabokova and Sylvia Schädlich

Assessing the Effectiveness of Virtual Reality Gaming to Reduce Anxiety and Increase Cognitive Bandwidth (poster) by Daniel Hawes and Ali Arya

Immersive Virtual Reality Training for Inspecting Flagger Work Zones (poster) by Daeyeol Chang, James Hopfenblatt, Praveen Edara and Bimal Balakrishnan

Session 6b: Workshop on Ethics in AI & XR (AIXR), part 2

Featuring keynotes by Wijnand IJsselsteijn, Leon Kester, paper presentations, and workshop activities.

 

See program on the AIXR workshop page.


Wednesday, December 16, 2020


Session 7a: VR focus (full and short papers)

Chair: Sebastian Günther, technical support: Calvin Ku

A Review of Electrostimulation-Based Cybersickness Mitigations (full paper)
by Gang Li, Mark McGill, Stephen Brewster and Frank Pollick

The Efficacy of a Virtual Reality-Based Mindfulness Intervention (full paper)
by Caglar Yildirim and Tara O'Grady

Under the (Plastic) Sea - Sensitizing People toward Ecological Behavior Using Virtual Reality Controlled by Users' Physical Activity (full paper)
by Carolin Strassmann, Alexander Arntz and Sabrina C. Eimler

An AR Work Instructions Authoring Tool for Human-Operated Industrial Assembly Lines (full paper)
by Traian Lavric, Emmanuel Bricard, Marius Preda and Titus Zaharia

Future Mobility Solutions: A Use Case for Understanding How VR Inhuences User Perception (short paper)
by Onur Yildirim, Catlin Pidel and Mirjam West

Session 7b: Workshop From Capture to Rendering of Digital Humans for AR/VR (CRDH), part 1

Featuring keynotes by Wan-Chun Alex Ma and Gerard Pons-Moll and presentations by four invited speakers.

 

See program on the CRDH workshop page.

 

Session 8: Keynote & poster teasers

Chair: Min-Chun Hu, technical support: Yi-Yun Hsieh

Best paper awards

Keynote: "title TBD" by Andrew Glassner
Abstract: TBD

Poster & demo teasers for next session

 

Session 9a: Posters & demos

Chairs: Simon Dirks, Andrii Matviienko, technical support: Hidde Veer, Aakash Makhija, Mihail Tsakov, Teodor Nikolov, Jian-Wei Peng, Ting-Yang Kao

Story ARtist (demo) by Marie Kegeleers and Rafael Bidarra

Study on Pseudo-Haptics during Swimming Motion in a Virtual Reality Space (demo) by Hirooki Aoki

Extended Abstract: CoShopper - Leveraging Artificial Intelligence for an Enhanced Augmented (demo) by Yasmeen Alhamdan, Saif Alabachi and Naimul Khan

High-Quality First-Person Rendering Mixed Reality Gaming System for in Home Setting (poster) by Yu-Yen Chung, Hung-Jui Guo, Hiranya Garbha Kumar and Balakrishnan Prabhakaran

A QoE and Visual Attention Evaluation on the Inhuence of Spatial Audio in 360 Videos (poster) by Amit Hirway, Yuansong Qiao and Niall Murray

A Review of Deep Learning Approaches to EEG-Based Classification of Cybersickness in Virtual Reality (poster) by Caglar Yildirim

Workload, Presence and Task Performance of Virtual Object Manipulation on WebVR (poster) by Wenxin Sun, Mengjie Huang, Rui Yang, Jingjing Zhang, Liu Wang, Ji Han and Yong Yue

Rainbow Learner: Lighting Environment Estimation from a Structural-Color Based AR Marker (poster) by Yuji Tsukagoshi, Yuki Uranishi, Jason Orlosky, Kiyomi Ito and Haruo Takemura

Training with a World Champion: Augmented Reality Applications in Sport: Design-Led Research (poster) by Stefania Palmieri, Alessio Righi, Mario Bisson and Alessandro Ianniello

Session 9b: Workshop From Capture to Rendering of Digital Humans for AR/VR (CRDH), part 2

Featuring keynotes by Wan-Chun Alex Ma and Gerard Pons-Moll and presentations by four invited speakers.

 

See program on the CRDH workshop page.


Thursday, December 17, 2020


Session 10a: AI focus (full and short papers, invited talk)

Chair: Peter Kán, technical support: Kangyou Yu

Style-Transfer GANs for Bridging the Domain Gap in Synthetic Pose (full paper)
by Pavel Rojtberg, Thomas Pöllabauer and Arjan Kuijper

Algorithm-Aware Neural Network Based Image Compression for High-Speed Imaging (short paper)
by Reid Pinkham, Tanner Schmidt and Andrew Berkovich

Lane Line Map Estimation for Visual Alignment (short paper)
by Minjung Son and Hyun Sung Chang

Social and Cognitive Modelling in Artificial Intelligence (invited talk)
by Mehdi Dastani

Session 10b: Workshop Modeling and Animating Realistic Crowds and Humans (MARCH), part 1

Featuring a keynote by Rachel McDonnell, various paper presentations and invited talks.

See program on the MARCH workshop page.

 

Session 11: Keynote & poster teasers

Chair: Omar Niamut, technical support: Xiaoyue Ma

Conference announcements (by general co-chair Wolfgang Hürst)

Keynote: "Making Room for AI in XR: What to expect" by Jacquelyn Ford Morie
Abstract: What will be the role of AI in our quickly evolving fields of XR? From smart NPCs to intelligent tutors for training, we can expect a wide range of AI applications to start populating our immersive creations. We should be considering both the benefits and the pitfalls we will encounter as they become commonplace.

Poster & demo teasers for next session

 

Session 12a: Posters & demos

Chairs: Florian Müller, Kangsoo Kim, technical support: Hidde Veer, Aakash Makhija, Mihail Tsakov, Teodor Nikolov, Amber Elferink

Annotation Tool for Precise Emotion Ground Truth Label Acquisition While Watching 360-degree VR Videos (demo) by Tong Xue, Abdallah El Ali, Gangyi Ding and Pablo Cesar

3D Model Retrieval Using Constructive Solid Geometry in Virtual Reality (demo) by Samuel Börlin, Ralph Gasser, Florian Spiess and Heiko Schuldt

Implementations of the Gesture-Based Immersive Interaction and ML-Driven Sound Generation for Haptic Companion Doll (poster) by Jen Tun Lee, R.P.C. Janaka Rajapakse, Yi-Ping Hung and Miyata Kazunori

A Preliminary Investigation into a Deep Learning Implementation for Hand Tracking on Mobile Devices (poster) by Monica Gruosso, Nicola Capece, Ugo Erra and Francesco Angiolillo

Artificial Intelligence Assisted Virtual Reality Warfighter Training System (poster) by Aaron Gluck, Jessica Chen and Ratnadeep Paul

Investigating Learners' Motivation Towards a Virtual Reality Learning Environment: A Pilot Study in Vehicle Painting (poster) by Miriam Mulders

From Virtual Reality to Neuroscience and Back: A Use Case on Peripersonal Hand Space Plasticity (poster) by Agata Marta Soccini, Francesca Ferroni and Martina Ardizzi

Eye Tracking Data Collection Protocol for VR for Remotely Located Subjects Using Blockchain and Smart Contracts (poster) by Efe Bozkir, Shahram Eivazi, Mete Akgün and Enkelejda Kasneci

Session 12b: Workshop Modeling and Animating Realistic Crowds and Humans (MARCH), part 2

Featuring a keynote by Rachel McDonnell, various paper presentations and invited talks.

See program on the MARCH workshop page.


Friday, December 18, 2020


Session 13a: Industry (industry papers, invited talk)

Chair: Vinoba Vinayagamoorthy, technical support: Guanghan Zhao

Juxtopia(R) CAMMRAD PREPARE: Wearable AI-AR Platform for Clinical Training Emergency First Response Teams (industry paper)
by Jayfus Doswell, Justin Johnson and Marcus Messam

Mill Instructor: Teaching Industrial CNC Procedures Using Virtual Reality (industry paper)
by Dustin Kessler, Alexander Arntz, Joachim Friedhoff and Sabrina Eimler

Interactive and Scalable Layout Synthesis with Design Templates (industry paper)
by Hameedullah Farooki, Esra Cansizoglu, Jae-Woo Choi and Tomer Weiss

XR Use Cases for Training and Productivity (invited talk)
by Saskia Groenewegen

Session 13b: Workshop Extended Reality in Medical Imaging (XRMI), part 1

Featuring keynotes by Ulrich Eck and Hoshang Kolivand plus various paper presentations.

 

See program on the XRMI workshop page.

 

Session 14: Keynote & presentation awards

Chair: Hai-Ning Liang, technical support: Shing-Ming Wong

Best presentation (poster/demo) award

Keynote: "Spatial Perception in Virtual Architectural Environments" by Victoria Interrante
Abstract: Immersive Virtual Reality technology has transformative potential applications in architecture and design. In this talk I will review some of the work my lab has done to address fundamental challenges in effectively deploying VR technologies in architecture and design applications, focusing primarily on our investigations of factors influencing spatial perception accuracy in immersive architectural environments, but also touching on some examples of the use of VR technology to investigate other questions of interest to architectural and interior designers.

IEEE AIVR 2021 announcement and outlook (by general co-chair Wolfgang Hürst)

 

Session 15a: Special session on "AI for VR/AR Gaming & Simulations"

Chair & session organizer: Remco Veltkamp & Georgios N. Yannakakis, technical support: Nahal Norouzi

A serious VR game for acrophobia therapy in an urban environment (full paper)
by Costa Anton, Oana Mitrut, Jiri Kosinka, Alin Moldoveanu and Florica Moldoveanu

Exploring the possibilities of Extended Reality in the world of firefighting (full paper)
by Janne Heirman, Shivam Selleri, Tom De Vleeschauwer, Charles Hamesse, Michel Bellemans, Evarest Schoofs and Rob Haelterman

Inverse Kinematics and Temporal Convolutional Networks for Sequential Pose Analysis in VR (full paper)
by David Jeong, Jackie Xu and Lynn Miller

Invisible Dynamic Mechanic Adjustment in Virtual Reality Games (full paper)
by Justus Robertson, Rogelio E. Cardona-Rivera and R. Michael Young

Session 15b: Workshop Extended Reality in Medical Imaging (XRMI), part 2

Featuring keynotes by Ulrich Eck and Hoshang Kolivand plus various paper presentations.

 

See program on the XRMI workshop page.