Getting Started - How do I use Effects with Motion Capture?
-
I would seriously consider using a Kinect for the tracking as long as the range limitations work out. All the tracking work has already been done for us with the Kinect so you are going to have a much easier time than with an IR camera and illuminators.
-
Matthew is one step ahead of me! The best and most affordable method is indeed the kinect camera. It solves 99% of your problems. Where you position it for distance it's and angle need consideration though.
-
Hi Jesse,
I tried to figure out how to create artificial water ripples. attached is the result. The comment are n dutch, but i guess it's all rather self-explanatory. It's based on overlapping blurred ovals that form the input of a displace actor. You can use a tracker to manipulate the zoomer values
Maybe it can be of some help for you.Best wishes,
Hans
9acdc0-waterreflectie.izz -
Jesse wrote me through the support form, and this was my response.
---------Dear Jesse,Well, this kind of interactive water effect has mostly been accomplished by some of the top practitioners in the field -- and usually because they can write their own C or C++ code. It is not an effect that is built in to Isadora -- especially if you wish to make it look super real.
But, one effect you can play with is the Displace actor. Put your video source into the top input. Then, in the second input, add a video that simulates some ripples. Try using the attached movie, called drops-center.mov to get started. The brightness of the second image "displaces" the first, simulating the water drop effect. The idea would be to have multiples of this movie -- or something like it -- combined with the MultiMix actor and fed into the second input of Displace at the same time.
Perhaps you can invent other ways to use the movements of the dancer to cause this to happen. You should investigate the Difference actor for example.
Then there is the issue of tracking the position of the dancer, so that he/she can influence the image. This is also requires some special lighting and hardware. This is also pretty sophisticated stuff if you've never done it before. It requires flooding the space with infra-red light and using an infra-red sensitive camera -- along with a technique called "background subtraction" to find the position of the dancer. Unfortunately, this is simply too complex for me to help you with here.
Do search the TroikaTronix forum at http://troikatronix.com/troikatronixforum/ as well as the old forum archive at http://forum.troikatronix.com/ -- there you should find some more information about IR tracking.
And, for any continued discussion on this topic, please join the new forum and post your questions there. Then, when your questions are answered, everyone in the community benefits. OK?
Best Wishes,
Mark -
Hello Everyone,
I can't thank you enough for your help and suggestions. They have been such a great help in leading us in the right direction! I'll be sure to post our results on the forums!
Sincerely,
Jesse -
Here is something I found when looking for the same kind of thing. It is the basic concept of water ripples over an image. It is for OSX and now is standalone. You can move the water with the mouse. I can hook this up to syphon and osc if you are interested in using it (you can send the background a stream over syphon and send the coordinates of the displacement via osc.
Fred -
Just wanted to say thank you for sharing your time intense researches and coding skills.
Best,
Michel -
That's great @Fred.
Thanks for sharing. -
sounds fun.. never for windows though.
-
@hanslas
Wow, I would never have tried to do that in izzy but you made a pretty fine attempt at water there!! Where in the Netherlands are you? -
@hanslas
thats true what Fred says, and for jessefryery if you conect the stage mouse watcher to the shapes horz and vert position, limit their input to -50 and +50 you can position the center of the ripple via mouse.Best,
Michel -
@Fred, thank you for sharing, that's great,
did you do it on Processing, or? -
I made this with openframeworks.
-
@Fred, your proposition of hooking up to syphon and osc your water-moves is great, could you do it please?
-
I will try to find the time, I am super busy with a show at the moment. It will take a bit of your juice though, check what resolution you can send and recieve over syphon while keeping the rest of your system going. I may get a chance to look at this mid to late next week.
Fred -
@Fred, thanks, that looks promising, I'm using syphon fine in different resolutions (but I'm sending max 720 vertical to projectors) with processing and QC, using osculator with wii and kinect, never used openframeworks...
-
@Fred, I fund out that there are 3 lines for Syphon implementation in openframeworks, if you like I could get it to you, or if you would send your patch, I have someone that could implement the syphon in your patch, we are still in research mode for openframework osc in Mac
-
You can make as many syphon channels as you like with OF, I have used 8 no probs. Openframeworks comes with OSC ready to go check the examples. You can get this effect going if you search for the ofxFx addons. If your going to get this going yourself this is all you need. I was saying before to check the capability of your machine that it can run these syphon channels and the Izzy patch you use. Best of luck Fred
-
@Fred, thanks. we could try if you would kindly share the code of your patch :)
best regards -
Ok here is an app that will do water ripples over an incoming syphon stream and send the results back out syphon. Make sure you have syphon working on your system and use the simple client and simple server apps to check out your setup. This is all GPU based and at SD PAL it runs 300fps for me. All parameters are controlled by OSC and save to XML if you want. I tested this a bit but I cannot really provide support as I am pretty busy now (I made it on a train racing against the clock as my battery died but did a bunch of testing and it seems pretty solid). The source code is there if you want to have a play but you will have to setup openframeworks and get the required addons to get it going. Of course as it is syphon it is mac only. There is an Izzy patch there as well to get you started. Needs core addons and some kind of video input but you could swap it for whatever you want.
Please let me know if this is useful and if you are using it in a show- and of course let me know if it works.Fredhttp://goo.gl/vBLnX
