[ANSWERED] Isadora, body mapping and Kinect 2 camera

ckeng

Hi both!!

These are so precious and useful for me to know. I will definitely pass these ideas to the choreographer.

I tried to open the file you kindly shared. It says the Open NI is missing. Where can I find them? I tried the file from the tutorial and it's the same.

I'm also thinking another problem that how should I build the contents? Can I create something with Isadora or I can actually build the patch in other programs like Processing or Touchdesigner and send it in Isadora? The idea is keep the projection in the body so can I use alpha mask and insert the image in the body? I would love to hear what you guys have played with the program and get inspired! Thanks so so so much!!!

Cheng

Woland

@ckeng said:

Where can I find them?

https://troikatronix.com/add-ons/openni-tracker/

DusX

@woland said:

@ckeng said:

Where can I find them?

https://troikatronix.com/add-ons/openni-tracker/

Within Isadora, you can insert videos using masks (black and white images/videos) or by layering with alpha channels.
Putting an image into an area is the easy part, ensuring the area lands on the body/canvas is the more complicated part (as mentioned above).
The content you create and how you create it will depend on the effect you are trying to achieve. If for example, you wanted to create an army or marching ants that walk around the perimeter of the body form, that would require some additional programming and might be suited to Processing. On the other hand, if you wanted to place a time-lapse sunset on the body, a video file layered inside Isadora could easily provide the desired effect.

ckeng

@dusx

I think additional programming is too much for the project so we are looking for using some stock video and images as the resources. I'm not super understand the last bit. If I want to put the sunset video on the body, how can I achieve that? Will the image follow the movement of the body?

Woland

@dusx said:

On the other hand, if you wanted to place a time-lapse sunset on the body, a video file layered inside Isadora could easily provide the desired effect.

@ckeng This file shows basically what Dusx was saying here. You use either the Skeleton Decoder or an Eyes++ actor to find the center of the body and then use another actor like a Zoomer to keep the image of the sunset centered on the body. Here's a (very choppy) gif of this method in action: https://recordit.co/0fqcrD8fsE

ckeng

@woland

I tried to install the plugin and learn from the tutorial but it kept saying that it's not installed. I followed all the instructions for Window system and Kinect 2. I have installed the SDK and read the text file but it's still not working.

I got these codes when I open the tutorial file.

OpenNIl Tracker BETA (ID = '5F4F4E42")

Skeleton Decoder (ID = '5F736B6C')

Skeleton Visualizer (ID = '5F736B76')

Woland

@ckeng

You have not installed the OpenNI Plugins then.

Go here: https://troikatronix.com/add-o...
Get the download for Windows
Unzip the file
Open the folder "OpenNI Tracker Windows"
Double left-click the file "__Double Click To Install Plugins__.bat"
If you're still having trouble open the file "__READ ME__ Installing the Tracker Plugins.rtf" and read the steps in the section "Installing OpenNI Tracker and Associated Plugins"

ckeng

@woland

I tried a few times and the plugin folders are in Isadora actor plugin folder but I still can't find a OpenNi actor. Not sure if I did anything wrong. I have tried this with Kinect v1 on another device and it worked well.

DusX

@ckeng

Please ensure your plugins look like the plugins in my plugins folder.
The .izzyplug folders need to be at: C:\Program Files\Common Files\TroikaTronix\Isadora Plugins

I have had a few users place these within subfolders and this does not work.

ckeng

@dusx

Thank you finally it works!!! Now I have to figure it out how can I play with the sensor.

ckeng

@woland

Hi,

I tried to copy your network but it turns out a bit different. The photo is still in rectangular shape which means the body is not masking it. Also, I still can see the background of the body(my room). Is there a way to filter it out?

I suppose this is only for rendering in the projector but not for body mapping? Do I have to do calligraphy in Isadora?

dbini

@ckeng

how is your NI watcher set up? maybe you have it set to 'show background'? this would output a rectangle of video. if you set it to 'hide background' or 'ghost' then you only get pixels output from the human shapes

Woland

@woland said:

This file shows basically what Dusx was saying here.

@ckeng I linked my file in the words "this file" so you can try my exact setup.