Artworkmaker
Face Substitution on Vimeo by Kyle McDonald
Feel like trying on a new face? Now you can creep out your video chat buddies with a real-time face substitution system developed by programmer Arturo Castro. The video above shows Castro trying on faces from a diverse cast of characters, from Michael Jackson to Marilyn Monroe. To complete the freaky look, the virtual masks adapt to his ever-changing expressions.
The program takes advantage of clever face tracking code developed by computer scientist Jason Saragih from the Commonwealth Scientific and Industrial Research Organisation (CSIRO), which detects faces in photos and overlays them with a triangular mesh. Castro's system can then match this well-defined structure - which stretches and deforms to adapt to changing expressions - to a face in webcam footage. Cartoon faces present more of a challenge, since the tracking library was trained to pick out human faces.
Working on an idea with Arturo Castro vimeo.com/29279198 I feel like "good" blending looks almost too natural to be surprising. It doesn't leave any interpolation up to your imagination. It's possible to push this style further, so it's less of a blend and more of a replacement, but then you get unnatural colors and shadows.
FaceTracker library from Jason Saragih web.mac.com/jsaragih/FaceTracker/FaceTracker.html
ofxFaceTracker addon github.com/kylemcdonald/ofxFaceTracker
openFrameworks www.openframeworks.cc/
Watch this video on Vimeo. Video created by Kyle McDonald.
Face Substitution on Vimeo by Kyle McDonald
Feel like trying on a new face? Now you can creep out your video chat buddies with a real-time face substitution system developed by programmer Arturo Castro. The video above shows Castro trying on faces from a diverse cast of characters, from Michael Jackson to Marilyn Monroe. To complete the freaky look, the virtual masks adapt to his ever-changing expressions.
The program takes advantage of clever face tracking code developed by computer scientist Jason Saragih from the Commonwealth Scientific and Industrial Research Organisation (CSIRO), which detects faces in photos and overlays them with a triangular mesh. Castro's system can then match this well-defined structure - which stretches and deforms to adapt to changing expressions - to a face in webcam footage. Cartoon faces present more of a challenge, since the tracking library was trained to pick out human faces.
Working on an idea with Arturo Castro vimeo.com/29279198 I feel like "good" blending looks almost too natural to be surprising. It doesn't leave any interpolation up to your imagination. It's possible to push this style further, so it's less of a blend and more of a replacement, but then you get unnatural colors and shadows.
FaceTracker library from Jason Saragih web.mac.com/jsaragih/FaceTracker/FaceTracker.html
ofxFaceTracker addon github.com/kylemcdonald/ofxFaceTracker
openFrameworks www.openframeworks.cc/
Watch this video on Vimeo. Video created by Kyle McDonald.