I’ve spent a couple of days porting my gesture library to iOS to do some tests with the iPad 2’s front-facing camera. I also added head tracking with OpenCV for Head-Coupled Perspective (HCP) and a sort of 3D effect. It’s an early prototype for an ongoing project at the NCCA, still a lot to do, but I thought I’d give you a short preview. Stay tuned! The system is implemented in C++ and some Objective-C (for iOS glue code), powered by openFrameworks.
Update: New video showing an updated version with some new functions like the feature in the end that could be used for some sort of AR shooter game.