Getting Started - How do I use Effects with Motion Capture?

  • Hey,

    Thank you so much! That was a great help to get me going. I have been running into the problem with my camera also picking up the projections. Is their a specific kind of InfraRed camera you would recommend getting?

    Thanks so much,


  • Beta Tester

    I would seriously consider using a Kinect for the tracking as long as the range limitations work out. All the tracking work has already been done for us with the Kinect so you are going to have a much easier time than with an IR camera and illuminators.

  • Tech Staff

    Matthew is one step ahead of me! The best and most affordable method is indeed the kinect camera. It solves 99% of your problems. Where you position it for distance it's and angle need consideration though.

  • Hi Jesse,

    I tried to figure out how to create artificial water ripples. attached is the result. The comment are n dutch, but i guess it's all rather self-explanatory. It's based on overlapping blurred ovals that form the input of a displace actor. You can use a tracker to manipulate the zoomer values
    Maybe it can be of some help for you.

    Best wishes,

  • Jesse wrote me through the support form, and this was my response.

    Dear Jesse,

    Well, this kind of interactive water effect has mostly been accomplished by some of the top practitioners in the field -- and usually because they can write their own C or C++ code. It is not an effect that is built in to Isadora -- especially if you wish to make it look super real.

    But, one effect you can play with is the Displace actor. Put your video source into the top input. Then, in the second input, add a video that simulates some ripples. Try using the attached movie, called to get started. The brightness of the second image "displaces" the first, simulating the water drop effect. The idea would be to have multiples of this movie -- or something like it -- combined with the MultiMix actor and fed into the second input of Displace at the same time.

    Perhaps you can invent other ways to use the movements of the dancer to cause this to happen. You should investigate the Difference actor for example.

    Then there is the issue of tracking the position of the dancer, so that he/she can influence the image. This is also requires some special lighting and hardware. This is also pretty sophisticated stuff if you've never done it before. It requires flooding the space with infra-red light and using an infra-red sensitive camera -- along with a technique called "background subtraction" to find the position of the dancer. Unfortunately, this is simply too complex for me to help you with here.

    Do search the TroikaTronix forum at as well as the old forum archive at -- there you should find some more information about IR tracking.

    And, for any continued discussion on this topic, please join the new forum and post your questions there. Then, when your questions are answered, everyone in the community benefits. OK?

    Best Wishes,

  • Hello Everyone,

    I can't thank you enough for your help and suggestions. They have been such a great help in leading us in the right direction! I'll be sure to post our results on the forums!


  • Here is something I found when looking for the same kind of thing. It is the basic concept of water ripples over an image. It is for OSX and now is standalone. You can move the water with the mouse. I can hook this up to syphon and osc if you are interested in using it (you can send the background a stream over syphon and send the coordinates of the displacement via osc.


  • Tech Staff


    Just wanted to say thank you for sharing your time intense researches and coding skills.


  • Tech Staff

    That's great @Fred.

    Thanks for sharing.

  • Tech Staff

    sounds fun.. never for windows though.

  • @hanslas
    Wow, I would never have tried to do that in izzy but you made a pretty fine attempt at water there!! Where in the Netherlands are you?

  • Tech Staff

    thats true what Fred says, and for jessefryery if you conect the stage mouse watcher to the shapes horz and vert position, limit their input to -50 and +50 you can position the center of the ripple via mouse.


  • @Fred, thank you for sharing, that's great,
    did you do it on Processing, or?

  • I made this with openframeworks.

  • @Fred, your proposition of hooking up to syphon and osc your water-moves is great, could you do it please?

  • I will try to find the time, I am super busy with a show at the moment. It will take a bit of your juice though, check what resolution you can send and recieve over syphon while keeping the rest of your system going. I may get a chance to look at this mid to late next week.


  • @Fred, thanks, that looks promising, I'm using syphon fine in different resolutions (but I'm sending max 720 vertical to projectors) with processing and QC, using osculator with wii and kinect, never used openframeworks...

  • @Fred, I fund out that there are 3 lines for Syphon implementation in openframeworks, if you like I could get it to you, or if you would send your patch, I have someone that could implement the syphon in your patch, we are still in research mode for openframework osc in Mac

  • You can make as many syphon channels as you like with OF, I have used 8 no probs. Openframeworks comes with OSC ready to go check the examples. You can get this effect going if you search for the ofxFx addons. If your going to get this going yourself this is all you need. I was saying before to check the capability of your machine that it can run these syphon channels and the Izzy patch you use. Best of luck Fred

  • @Fred, thanks. we could try if you would kindly share the code of your patch :)
    best regards