April 18th, 2011

Gesture Library + Head Tracking prototype on iPad 2 [Update]

I’ve spent a couple of days porting my gesture library to iOS to do some tests with the iPad 2’s front-facing camera. I also added head tracking with OpenCV for Head-Coupled Perspective (HCP) and a sort of 3D effect. It’s an early prototype for an ongoing project at the NCCA, still a lot to do, but I thought I’d give you a short preview. Stay tuned! The system is implemented in C++ and some Objective-C (for iOS glue code), powered by openFrameworks.


Update: New video showing an updated version with some new functions like the feature in the end that could be used for some sort of AR shooter game.


Update 2: Thanks to Renato Mitra for featuring this video on his site, one of the most popular blogs in Switzerland. Salü Äpflblog-Bsüecher :-)



Leave a Reply