body mapping, how to do
-
@maximortal It is going to be 3d, there is a model or mesh of the body that is being deformed with the movements, rotations are tight, this part is not so hard (I see the standard kinect dropouts on the body twists, it would not be there if it was not real time). There is also some kind of input output calibration between the kinect and projector.
Some resources
-
yess, I agree. I'm supposing something like you described. About camera calibration is ages that i'm hoping that Mark introduces this feature in Isadora. At moment when I need it to bodymap someone beacause kinect has no so wide detection area I do it manually...but something automated is far better!
-
@maximortal said:
Roberto Bolle body mapping
Looking at the video, it's not 3D modelling and mapping, only a mask following the body, certainly with kinect (we see sometime the image outside the body). There is no calibration or 3d mapping, when there is a lighting heart, the body spin, but not the heart… That's completely possible with Isadora with a kinect sending depth image from Processing to Isadora via Syphon. Real 3D mapping and calibration make the projection as texture really attached to the body. You can do that using blacktrax with D3, but you need the budget!
Jacques Hoepffner http://hoepffner.info
GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2 -
All the answers as to how they did it available here:
http://senseable.mit.edu/bits/...Clearly this work has been going on for a long time: this video from 2011!
Intel NUC8i7HVK Hades Canyon VR Gaming NUC, i7-8809G w/ Radeon RX Vega M GH 4GB Graphics, 32GB RAM, 2 x NVMe SSD
Gigabyte Aero 15 OLED XD. Intel Core i7-11800H, NVidia RTX3070, 32GB RAM 2 x NVMe SSD
PC Specialist Desktop: i9-14900K, RTX4070Ti, 64GB RAM, Win11Pro
www.natalieinsideout.com -
Actually, this does seem to be really old stuff, as far as I can tell: MIT list it as a project from 2011:
http://senseable.mit.edu/bits/
There's no sign of the work on the Queen Mary University website... -
Here's some more of Roberto Bolle's 'interactivity' work:
-
@jhoepffner has backtrax changed? Last time I saw there is no skeleton tracking, just beacons, it is a modified version of an optitrack system (that does have skeleton tracking), cut down to use active beacons for a smaller marker footprint, (and a premium price tag) which each have 6dof tracking. perfect for rigid objects, not for anything flexible.
-
To my knowledge backtrax have no skeleton tracking and is made for rigid body, making it perfect for 3D mapping on objects.
With Optitrack and the NatNet protocol, you can receive the data in Unity 3D. It could be possible for a fluent C++ programer to translate NatNet to OSC, enabling reception in Isadora or TouchDesigner. But the price of the minimum setting fo a 10x10 m stage is 150 000 $… That's not my habitual economy, unfortunately.
Jacques Hoepffner http://hoepffner.info
GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2 -
-
@juriaan said:
https://github.com/hku-ect/Nat...
thank you for the info, I just have to find 150000$ for the hardware. Any producer interested?
Jacques Hoepffner http://hoepffner.info
GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2 -
@jhoepffner Check the optitrak forums, there are often older systems going cheap if you really want one, they are ok for smaller shows if you work with thier limitations. I toured with a larger system for a few years (after a smaller 8 camera rig) and to be honest it was amazing but a pain in the ass. You can do some amazing things, but the setup and break show after show was a bit of a nightmare.
