Title: Coded Facial Expression
Booth Number: et_0009

Summary: Projection based augmented reality, which is a type of Spatial Augmented Reality (SAR), can directly apply augmentation to the real world by illumination projection. The use of a camera enables the target tracking and geometrical correction of the projected image on SAR applications.
In the conventional projection mapping procedure, video content is prepared before projection onto the target object to overlay it. The problem is that the alignment procedure for the projection mapping is always a time-consuming task. However, if we could embed the alignment information or the manipulation procedure on the surface on the object, object tracking would be unnecessary.

In our previous work, we proposed a shading illusion that animates the shading of 3D content on printed materials for 3D representation. In this technique, the normal vector map of 3D contents is coded by color on the printed materials and it is decoded from the reflectance image, which is estimated in the projector camera system. Then the system displays the shading animation by using successive radiometric compensation. The benefit of this method is that it nether requires a geometrical model nor the estimation of the position and/or posture.

This demonstration shows an innovative projection mapping technique using a such coded printing technique for the manipulation of a facial expression on a printed photograph. By using our manipulation technique, the neutral facial expression in a photograph changes to an angry or smiling face by the radiometric compensation of which the reference is given by the coded information.

Presenter(s):
Toshiyuki Amano, Wakayama University (Japan)