The world is changing, and the way we work and collaborate is evolving with it. As technology continues to advance at a rapid pace, we are no longer bound by physical distance or geographical barriers. There is a need to develop new technology that allows people to collaborate together remotely, as if they were face to face.
Our project features exploration of cutting-edge techniques that allow users from remote locations to connect and work together seamlessly with those in local, physical environments. One of the important aspects of collaboration is being able to share a view of your surroundings with a remote person, so that they can feel that they are there.
To do this, we’ve created multiple collaborative systems that integrate 3D reconstruction, 360-degree live videos, 360-degree static images, with a range of different hardware prototypes. For example, one of our prototypes allows people to live stream 360 video from their surroundings, placed inside a 3D virtual model of the same space. People can swap freely between viewing the 360 video or experiencing the 3D space.
Our goal is to bring people closer together mentally and empathetically, no matter where they are in the world. With the prototypes we are developing, people can be transported to a virtual space where they can collaborate, communicate, and interact with anyone, anywhere, anytime.Project Video(s):
T. Teo, M. Norman, G. A. Lee, M. Billinghurst and M. Adcock. “Exploring interaction techniques for 360 panoramas inside a 3D reconstructed scene for mixed reality remote collaboration.” In: J Multimodal User Interfaces. (JMUI), 2020.
Z. Li, T. Teo, G. Lee, M. Adcock, M. Billinghurst, H. Koike. “A collaborative 360-degree communication system for VR”. In Proceedings of the 2020 Designing Interactive Systems Conference (DIS2020). ACM, 2020.
T. Teo, G. A. Lee, M. Billinghurst and M. Adcock. “360Drops: Mixed Reality Remove Collaboration using 360° Panoramas within the 3D Scene.” In: ACM SIGGRAPH Conference and Exhibition on Computer Graphics & Interactive Technologies in Asia. (SA 2019), Brisbane, Australia, 2019.
T. Teo, A. F. Hayati, G. A. Lee, M. Billinghurst and M. Adcock. “A Technique for Mixed Reality Remote Collaboration using 360° Panoramas in 3D Reconstructed Scenes.” In: ACM Symposium on Virtual Reality Software and Technology. (VRST), Sydney, Australia, 2019.
T. Teo, L. Lawrence, G. A. Lee, M. Billinghurst, and M. Adcock. (2019). “Mixed Reality Remote Collaboration Combining 360 Video and 3D Reconstruction”. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Paper 201, 14 pages.
G. A. Lee, T. Teo, S. Kim, and M. Billinghurst. (2017). “Mixed reality collaboration through sharing a live panorama”. In SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications (SA 2017). ACM, New York, NY, USA, Article 14, 4 pages.