Check out this video below…
Papervision – Augmented Reality (extended) from dpinteractive on Vimeo.
I saw this posted on Motionographer which led me to the creator’s site at Digital Pictures Interactive which let’s you try it all out yourself. If you have a webcam or iSight, it is definitely worth playing around with.