Persicope Projection Prototype

Bewertung:  / 1

A metaphor of a virtual window into the personal space of your remote communication partner. This prototype application is a by-product of my master's thesis submitted in june 2011.

A video is transmitted between both devices. One device records the video and sends it to the other device wirelessly. The receiving device tracks the user's relative head position and modifies the video frame position and size accordingly. The video frames are rendered as head-coupled OpenGL texture using off-axis rendering to create the impression of 'looking through a real-world window'.

Imagine following scenario:

Your friend is at home hundreds of miles away an therefore couldn't join you for the great concert. Nowadays, high bandwidth and powerful mobile camera devices allow easy recording and content sharing at a reasonable quality. Several services such as UStream demonstrate location-based real-time video sharing using mobile devices.

You can easily share your personal experiences based on the metaphor of a virtual window into the remote space. The idea is to transmit video data in real-time between two or more devices. Additionally, all devices which receive video streams instrument their in-built front facing camera to track the viewer's relative head position. Based on the relative head position, it should be possible to modify the video data. The video frames are rendered as OpenGl textures in a 3D virtual scene, which is modified to create the impression of looking through a window. The window-like effect can be achieved by adaption of the field of view of the virtual scene according to the relative 3D head position. In addition, off-axis rendering is applied to reduce the distortion of virtual objects which occurs if the virtual camera is not axis aligned.

This is a project with the Human Computer Interaction Lab at Hasso Plattner Institute: http://www.hpi.uni-potsdam.de/baudisch/projects.html