• Products
    • Isadora
    • Get It
    • ADD-ONS
    • IzzyCast
    • Get It
  • Forum
  • Help
  • Werkstatt
  • Newsletter
  • Impressum
  • Dsgvo
  • Press
  • Isadora
  • Get It
  • ADD-ONS
  • IzzyCast
  • Get It
  • Press
  • Dsgvo
  • Impressum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    Getting Started - How do I use Effects with Motion Capture?

    Showcase
    10
    36
    24426
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Skulpture
      Skulpture Izzy Guru last edited by

      Hi,

      The first issue you are likely to encounter is video feedback. If you have a projector pointing and the floor and presumably a camera to track the dancer pointing toward the floor then the camera and software will see all movement.
      And since all the software see's is pixels it can't work out which one is the human. So you may need to think about InfraRed lighting and InfraRed cameras.
      To create the water effect is quite hard; i've never done it. Off the top of my head I would look at the displace actor and maybe the shimmer effect. The displace actor might have to be mixed with a large image of water created in photoshop or similar. I'm sure some other users can help with this too, or have an other idea (there are probably many ways).
      But the area I do know about is the actual motion tracking. You need to use eyes actor and track the movement. I have some tutorials on my blog.
      http://vjskulpture.wordpress.com/category/isadora-tutorials/
      http://vjskulpture.wordpress.com/2011/02/09/basic-motion-tracking/
      http://vjskulpture.wordpress.com/2011/02/13/the-problems-with-motion-tracking/
      This will get you going for now.

      Graham Thorne | www.grahamthorne.co.uk
      RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
      RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
      RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

      1 Reply Last reply Reply Quote 0
      • jessefryery
        jessefryery last edited by

        Hey,

        Thank you so much! That was a great help to get me going. I have been running into the problem with my camera also picking up the projections. Is their a specific kind of InfraRed camera you would recommend getting?

        Thanks so much,

        Jesse

        1 Reply Last reply Reply Quote 0
        • MatthewH
          MatthewH Beta Tester last edited by

          I would seriously consider using a Kinect for the tracking as long as the range limitations work out. All the tracking work has already been done for us with the Kinect so you are going to have a much easier time than with an IR camera and illuminators.

          Matthew Haber :: matthewhaber.com :: besidedigital.com :: Download my actors: http://www.matthewhaber.com/isadora-actors

          1 Reply Last reply Reply Quote 0
          • Skulpture
            Skulpture Izzy Guru last edited by

            Matthew is one step ahead of me! The best and most affordable method is indeed the kinect camera. It solves 99% of your problems. Where you position it for distance it's and angle need consideration though.

            Graham Thorne | www.grahamthorne.co.uk
            RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
            RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
            RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

            1 Reply Last reply Reply Quote 0
            • H
              hanslas last edited by

              Hi Jesse,

              I tried to figure out how to create artificial water ripples. attached is the result. The comment are n dutch, but i guess it's all rather self-explanatory. It's based on overlapping blurred ovals that form the input of a displace actor. You can use a tracker to manipulate the zoomer values
              Maybe it can be of some help for you.

              Best wishes,
              Hans
              9acdc0-waterreflectie.izz

              1 Reply Last reply Reply Quote 0
              • mark
                mark last edited by

                Jesse wrote me through the support form, and this was my response.

                ---------
                Dear Jesse,

                Well, this kind of interactive water effect has mostly been accomplished by some of the top practitioners in the field -- and usually because they can write their own C or C++ code. It is not an effect that is built in to Isadora -- especially if you wish to make it look super real.

                But, one effect you can play with is the Displace actor. Put your video source into the top input. Then, in the second input, add a video that simulates some ripples. Try using the attached movie, called drops-center.mov to get started. The brightness of the second image "displaces" the first, simulating the water drop effect. The idea would be to have multiples of this movie -- or something like it -- combined with the MultiMix actor and fed into the second input of Displace at the same time.

                Perhaps you can invent other ways to use the movements of the dancer to cause this to happen. You should investigate the Difference actor for example.

                Then there is the issue of tracking the position of the dancer, so that he/she can influence the image. This is also requires some special lighting and hardware. This is also pretty sophisticated stuff if you've never done it before. It requires flooding the space with infra-red light and using an infra-red sensitive camera -- along with a technique called "background subtraction" to find the position of the dancer. Unfortunately, this is simply too complex for me to help you with here.

                Do search the TroikaTronix forum at http://troikatronix.com/troikatronixforum/ as well as the old forum archive at http://forum.troikatronix.com/ -- there you should find some more information about IR tracking.

                And, for any continued discussion on this topic, please join the new forum and post your questions there. Then, when your questions are answered, everyone in the community benefits. OK?

                Best Wishes,
                Mark

                20a128-drops-center.mov.zip

                Media Artist & Creator of Isadora
                Macintosh SE-30, 32 Mb RAM, MacOS 7.6, Dual Floppy Drives

                1 Reply Last reply Reply Quote 0
                • jessefryery
                  jessefryery last edited by

                  Hello Everyone,

                  I can't thank you enough for your help and suggestions. They have been such a great help in leading us in the right direction! I'll be sure to post our results on the forums!

                  Sincerely,
                  Jesse

                  1 Reply Last reply Reply Quote 0
                  • Fred
                    Fred last edited by

                    Here is something I found when looking for the same kind of thing. It is the basic concept of water ripples over an image. It is for OSX and now is standalone. You can move the water with the mouse. I can hook this up to syphon and osc if you are interested in using it (you can send the background a stream over syphon and send the coordinates of the displacement via osc.

                    Fred

                    54d615-water-example.zip

                    http://www.fredrodrigues.net/
                    https://github.com/fred-dev
                    OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                    Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                    1 Reply Last reply Reply Quote 0
                    • Michel
                      Michel Izzy Guru last edited by

                      @Fred

                      Just wanted to say thank you for sharing your time intense researches and coding skills.

                      Best,
                      Michel

                      Michel Weber | www.filmprojekt.ch | rMBP (2019) i9, 16gig, AMD 5500M 8 GB, OS X 10.15 | located in Winterthur Switzerland.

                      1 Reply Last reply Reply Quote 0
                      • Skulpture
                        Skulpture Izzy Guru last edited by

                        That's great @Fred.

                        Thanks for sharing.

                        Graham Thorne | www.grahamthorne.co.uk
                        RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
                        RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
                        RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

                        1 Reply Last reply Reply Quote 0
                        • DusX
                          DusX Tech Staff last edited by

                          sounds fun.. never for windows though.

                          Troikatronix Technical Support

                          • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                          • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
                          • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

                          Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                          1 Reply Last reply Reply Quote 0
                          • Fred
                            Fred last edited by

                            @hanslas
                            Wow, I would never have tried to do that in izzy but you made a pretty fine attempt at water there!! Where in the Netherlands are you?

                            http://www.fredrodrigues.net/
                            https://github.com/fred-dev
                            OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                            Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                            1 Reply Last reply Reply Quote 0
                            • Michel
                              Michel Izzy Guru last edited by

                              @hanslas
                              thats true what Fred says, and for jessefryery if you conect the stage mouse watcher to the shapes horz and vert position, limit their input to -50 and +50 you can position the center of the ripple via mouse.

                              Best,
                              Michel

                              Michel Weber | www.filmprojekt.ch | rMBP (2019) i9, 16gig, AMD 5500M 8 GB, OS X 10.15 | located in Winterthur Switzerland.

                              1 Reply Last reply Reply Quote 0
                              • bruper
                                bruper last edited by

                                @Fred, thank you for sharing, that's great,
                                did you do it on Processing, or?

                                17"MBP 2.93GHZ Core2Duo mid 2009 - OSX10.11.6 - 8GB, 1TBCrucial_SSD, izzy 3.0.7

                                1 Reply Last reply Reply Quote 0
                                • Fred
                                  Fred last edited by

                                  I made this with openframeworks.

                                  http://www.fredrodrigues.net/
                                  https://github.com/fred-dev
                                  OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                                  Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                                  1 Reply Last reply Reply Quote 0
                                  • bruper
                                    bruper last edited by

                                    @Fred, your proposition of hooking up to syphon and osc your water-moves is great, could you do it please?

                                    17"MBP 2.93GHZ Core2Duo mid 2009 - OSX10.11.6 - 8GB, 1TBCrucial_SSD, izzy 3.0.7

                                    1 Reply Last reply Reply Quote 0
                                    • Fred
                                      Fred last edited by

                                      I will try to find the time, I am super busy with a show at the moment. It will take a bit of your juice though, check what resolution you can send and recieve over syphon while keeping the rest of your system going. I may get a chance to look at this mid to late next week.

                                      Fred

                                      http://www.fredrodrigues.net/
                                      https://github.com/fred-dev
                                      OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                                      Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                                      1 Reply Last reply Reply Quote 0
                                      • bruper
                                        bruper last edited by

                                        @Fred, thanks, that looks promising, I'm using syphon fine in different resolutions (but I'm sending max 720 vertical to projectors) with processing and QC, using osculator with wii and kinect, never used openframeworks...

                                        17"MBP 2.93GHZ Core2Duo mid 2009 - OSX10.11.6 - 8GB, 1TBCrucial_SSD, izzy 3.0.7

                                        1 Reply Last reply Reply Quote 0
                                        • bruper
                                          bruper last edited by

                                          @Fred, I fund out that there are 3 lines for Syphon implementation in openframeworks, if you like I could get it to you, or if you would send your patch, I have someone that could implement the syphon in your patch, we are still in research mode for openframework osc in Mac

                                          17"MBP 2.93GHZ Core2Duo mid 2009 - OSX10.11.6 - 8GB, 1TBCrucial_SSD, izzy 3.0.7

                                          1 Reply Last reply Reply Quote 0
                                          • Fred
                                            Fred last edited by

                                            You can make as many syphon channels as you like with OF, I have used 8 no probs. Openframeworks comes with OSC ready to go check the examples. You can get this effect going if you search for the ofxFx addons. If your going to get this going yourself this is all you need. I was saying before to check the capability of your machine that it can run these syphon channels and the Izzy patch you use. Best of luck Fred

                                            http://www.fredrodrigues.net/
                                            https://github.com/fred-dev
                                            OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                                            Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post