From CVLAB -- Computer Vision Laboratory:

Augmenting Deformable Surfaces

Starting from our technique for fast keypoint matching detection, we developed real-time techniques to detect deformable surfaces. Using wide-baseline correspondences between an input image and a model image, we recover quickly and accurately the deformations of a deforming surface. In addition, we also model the lighting and detect occlusions.

As a result, we can realistically augment the surface. For example, let us imagine that we want to augment the image of a T-shirt shown below with a platypus shown next to it.

Model image

Virtual character

Augmented image

Our approach was used by Camille Scherrer, a designer from ECAL, to create a magic book.

From EPFL+ECAL Lab:

The Haunted Book

Diploma project by an ECAL Media & Interaction Design student with the EPFL CVLab. An artwork that relies on recent Computer Vision and Augmented Reality techniques to animate the illustrations of a poetry book. Because we don’t need markers, we can achieve seamless integration of real and virtual elements to create the desired atmosphere. The visualization is done on a computer screen to avoid cumbersome Head-Mounted Displays. The camera is hidden into a desk lamp for easing even more the spectator immersion.

Magic Book by Camille Scherrer -- augmented reality art installation:

Thanks to Annabeth Robinson for sharing this.