body mapping, how to do

Maximortal · Jan 8, 2018, 9:16 AM

hi folks,

recently I saw on Italian television a show with a nice body mapping and I'm debating with a friend if it's a 2d or 3d mapping.

I'm not sure if you can see the following link outside from italy but if you can plz tell me your opinion

Roberto Bolle body mapping

cheers

Fred · Jan 8, 2018, 12:16 PM

@maximortal It is going to be 3d, there is a model or mesh of the body that is being deformed with the movements, rotations are tight, this part is not so hard (I see the standard kinect dropouts on the body twists, it would not be there if it was not real time). There is also some kind of input output calibration between the kinect and projector.

Some resources

http://artandcode.com/3d/works...

https://github.com/elliotwoods...

Maximortal · Jan 8, 2018, 2:59 PM

yess, I agree. I'm supposing something like you described. About camera calibration is ages that i'm hoping that Mark introduces this feature in Isadora. At moment when I need it to bodymap someone beacause kinect has no so wide detection area I do it manually...but something automated is far better!

jhoepffner · Jan 8, 2018, 3:44 PM

@maximortal said:

Roberto Bolle body mapping

Looking at the video, it's not 3D modelling and mapping, only a mask following the body, certainly with kinect (we see sometime the image outside the body). There is no calibration or 3d mapping, when there is a lighting heart, the body spin, but not the heart… That's completely possible with Isadora with a kinect sending depth image from Processing to Isadora via Syphon. Real 3D mapping and calibration make the projection as texture really attached to the body. You can do that using blacktrax with D3, but you need the budget!

mark_m · Jan 8, 2018, 5:41 PM

@maximortal

All the answers as to how they did it available here:
http://senseable.mit.edu/bits/...

Clearly this work has been going on for a long time: this video from 2011!

mark_m · Jan 8, 2018, 5:56 PM

Actually, this does seem to be really old stuff, as far as I can tell: MIT list it as a project from 2011:
http://senseable.mit.edu/bits/

There's no sign of the work on the Queen Mary University website...

mark_m · Jan 8, 2018, 6:11 PM

Here's some more of Roberto Bolle's 'interactivity' work:

Fred · Jan 9, 2018, 3:04 PM

@jhoepffner has backtrax changed? Last time I saw there is no skeleton tracking, just beacons, it is a modified version of an optitrack system (that does have skeleton tracking), cut down to use active beacons for a smaller marker footprint, (and a premium price tag) which each have 6dof tracking. perfect for rigid objects, not for anything flexible.

jhoepffner · Jan 9, 2018, 7:26 PM

@Fred

To my knowledge backtrax have no skeleton tracking and is made for rigid body, making it perfect for 3D mapping on objects.

With Optitrack and the NatNet protocol, you can receive the data in Unity 3D. It could be possible for a fluent C++ programer to translate NatNet to OSC, enabling reception in Isadora or TouchDesigner. But the price of the minimum setting fo a 10x10 m stage is 150 000 $… That's not my habitual economy, unfortunately.

Juriaan · Jan 9, 2018, 8:09 PM

@jhoepffner

https://github.com/hku-ect/Nat...

Did someone say Nat to OSC?

jhoepffner · Jan 9, 2018, 9:08 PM

@juriaan said:

https://github.com/hku-ect/Nat...

thank you for the info, I just have to find 150000$ for the hardware. Any producer interested?

Fred · Jan 9, 2018, 11:53 PM

@jhoepffner Check the optitrak forums, there are often older systems going cheap if you really want one, they are ok for smaller shows if you work with thier limitations. I toured with a larger system for a few years (after a smaller 8 camera rig) and to be honest it was amazing but a pain in the ass. You can do some amazing things, but the setup and break show after show was a bit of a nightmare.