Google has released the free BodyPix 2.0. This offers automatic identification of people against a relatively noisy background, and then spots and tracks each person’s twenty-four body parts. It then segments, ID’s and colours each body-part. It can do this even while being fed around 20-25 frames per second, on fairly standard hardware such as an iPhone.
Version 2.0 adds “multi-person support and improved accuracy”.
They also offer the sister-software PoseNet, enabling a basic emulation of what a Kinect does but via standard Webcams…
both BodyPix and PoseNet can be used without installation and just a few lines of code. You don’t need any specialized lenses to use these models — they work with any basic webcam or mobile camera. And finally users can access these applications by just opening a url. Since all computing is done on device, the data stays private. For all these reasons, we think BodyPix is easily accessible as a tool for artists, creative coders, and those new to programming.
So… how to plug this stuff into a nice little DAZ/Poser-friendly Webcam utility? One that, at the flick of a drop-down menu, will happily real-time puppet and animate any stock figure from an Aiko 3 up to a G8 or La Femme?