• Products
    • Isadora
    • Get It
    • ADD-ONS
    • IzzyCast
    • Get It
  • Forum
  • Help
  • Werkstatt
  • Newsletter
  • Impressum
  • Dsgvo
  • Press
  • Isadora
  • Get It
  • ADD-ONS
  • IzzyCast
  • Get It
  • Press
  • Dsgvo
  • Impressum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    ​recording silhouette

    How To... ?
    6
    11
    774
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Woland
      Woland Tech Staff @Eva last edited by

      @eva

      This might be helpful: https://community.troikatronix.com/topic/3316/video-infrared-tracking-workshop-from-werkstatt-2016?_=1724149070798

      TroikaTronix Technical Support
      New Support Ticket: https://support.troikatronix.com/support/tickets/new
      Support Policy: https://support.troikatronix.com/support/solutions/articles/13000064762
      Add-Ons: https://troikatronix.com/add-ons/ & https://troikatronix.com/add-ons/?u=woland
      Professional Services: https://support.troikatronix.com/support/solutions/articles/13000109444

      | Isadora Version: all of them | Mac Pro (Late 2013), macOS 10.14.6, 3.5GHz 6-core, 1TB SSD, 64GB RAM, Dual AMD FirePro D700s |

      1 Reply Last reply Reply Quote 0
      • Woland
        Woland Tech Staff @Eva last edited by

        @eva

        Also my answer from this thread about using Isadora to projection map onto a moving person, particularly this part, might be useful info:

        Kinect is good for small area tracking. Larger areas where you only need to track and project from one direction you can flood the wall behind the performer with infrared light and use an IR-sensitive camera in front of the performer so that the performer shows up as a dead spot in the IR camera feed, which gives you the silhouette you need to start warping in order to get it mapped onto the person

        TroikaTronix Technical Support
        New Support Ticket: https://support.troikatronix.com/support/tickets/new
        Support Policy: https://support.troikatronix.com/support/solutions/articles/13000064762
        Add-Ons: https://troikatronix.com/add-ons/ & https://troikatronix.com/add-ons/?u=woland
        Professional Services: https://support.troikatronix.com/support/solutions/articles/13000109444

        | Isadora Version: all of them | Mac Pro (Late 2013), macOS 10.14.6, 3.5GHz 6-core, 1TB SSD, 64GB RAM, Dual AMD FirePro D700s |

        1 Reply Last reply Reply Quote 0
        • CitizenJoe
          CitizenJoe last edited by

          Would the suf=ggestions from this thread work?
          Interesting Ipad OSC apps | TroikaTronix Forum

          Data OSC on the App Store (apple.com)

          iKeleton OSC on the App Store (apple.com)

          Cheers,

          Hugh

          Hugh in Winnipeg - All test machines, Win10/11 Pro, 64 bit, OS SSD and separate data SSD.
          Dell 7560, i9 11950H, 64 gigs, NVIDIA RTX A4000 w/8 GB GDDR6

          1 Reply Last reply Reply Quote 1
          • Fred
            Fred last edited by

            Re: [recording silhouette](/topic/8947/recording-silhouette)

            It sounds like you want to make recordings not do this in real time. If it’s real time then IR flooding of the background and using and IR camera feed would be the best bet. 

            You can also use some kind of green screen to do this. If you need really professional results you can also go for a hardware green screen tool like this https://www.blackmagicdesign.com/au/products/ultimatte which can do some amazing stuff and likely be rented. This unit can also help with recording videos for playback. 

            If it is all pre recorded the process you want is called rotoscoping. Most good video post production tools can do this in some way. The full version of Davinci resolve does this well. Other tools like Mocha are very good at this - Mocha was the industry stand for a long time. 

            There are also rotoscoping services where you can send a video and have it extracted (usually in China). This will be done with a combination of computer tools and human correction. 

            But of course AI is great at this and this tool is a good example https://www.vidio.ai/tools/online-rotoscoping

            Once you have the human form isolated from the background you can extract the silhouette easily. 

            Fred

            http://www.fredrodrigues.net/
            https://github.com/fred-dev
            OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
            Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

            E 1 Reply Last reply Reply Quote 1
            • J
              jtsteph @Eva last edited by

              @eva I have done many project using greescreen, rotoscoping and AI based rotoscoping. It can be quite labour intensive, but if you are able to prep the staging for your capture, you can make quick work of it. Here are a few routes to accomplishing what you would like to do.

              - green/blue screen: your wall would be painted chromakey blue or green and then the performers can be keyed out reasonably easily.
              - ai roto: having strong contrast between your performs and their background helps ai figure out what is what. Light coloured wall, performers in dark solid colours.

              - mocap: I am working on a project that also uses silhouettes. We captured the performance with motion capture technology. It is so utterly flexible to work with, it really inspires new ways of looking at movement! This can be done with inertia suits like Rococo suits or there are many AI based mocap tools that involve shooting the performance with a few cameras and uploading these materials to a service that will compile the video and return motion capture armatures for you to work with in blender or whatever cg package you would like to use.

              - J

              Isadora 4.0.2, W11 PRO 13700K (in a 4U case), 128GB RAM, 4 Lane M.2 Storage, RTX 3090, Ultraleap Motion 2, Behringer UMC404HD audio interface, Streamdeck XL, Streamdeck+, KorgNano Kontrol2.
              Website: http://justinstephenson.com

              dbini 1 Reply Last reply Reply Quote 2
              • dbini
                dbini @jtsteph last edited by

                Many years ago I worked with a circus performer who specialises in Chinese Pole. We filmed her in a green screen studio. it was pretty difficult because the vertical movement range was much bigger than with someone working on the floor, so the greenscreen backdrop had to be huge.
                More recently we put a pole dancer in a MoCap suit and the results were surprisingly good. If you want really clean silhouettes, I think the best way would be to MoCap the movement and generate the silhouettes in Blender or Unity or Unreal - you then have full control over the body shapes and camera angles.

                John Collingswood
                taikabox.com
                2019 MBPT 2.6GHZ i7 OSX15.3.2 16GB
                plus an old iMac and assorted Mac Minis for installations

                1 Reply Last reply Reply Quote 1
                • E
                  Eva @Fred last edited by

                  @fred said:

                  rotoscoping

                   Hi fred, it sounds actually very easy. So, it can also work if you have wires that are hanging in front of the dancers? They are connected on each side of the hip so that they can spin.Thanks for helping:)
                  Eva

                  Eva Esmann Behrens
                  Labtop: Macbook pro (Retina) 2015, 2,7 GHz,8 GB, MacOS Mojave
                  Mac Studio

                  Fred 1 Reply Last reply Reply Quote 0
                  • Fred
                    Fred @Eva last edited by Fred

                    @eva

                    It’s not that it is easy but the tools to do this kind of work are mature and advanced. You will likely, with any approach need to evaluate the workflow in two stages. The first, how well the initial background removal works and second how difficult it is to refine the separation- you will likely have to do some manual removal of the wires and general cleaning of the matte. 

                    Personally I would suggest using Davinci resolve as its newest magic mask iteration is very advanced and uses Resolves own AI engine to do the extraction. This is only available in the paid studio version not the free version of the software. 

                    Here is a tutorial that can get you started:

                    https://youtu.be/HAlfApCFQwI?si=a6Sv7E8QbwvzTqGO


                    here is another video that shows a few more advanced features including using fusion (which is inside Resolve), as well as removing things from being tracked (which you may have to do with the wires). Overall though this works very well and is simple to use with lots of options to refine the mask.


                    https://youtu.be/5PXu2l5YS1Q?si=UzZ9GfFNzhYTICAo

                    Definitely make things as easy as possible for the system so use steady camera shots, great lighting (and try to get good contrast between the foreground and background. Use a good quality camera, something that has a global shutter and at least 422 colour encoding. 

                    Getting good quality video with high contrast foreground and background will make any of the workflows you use much easier. 

                    With good quality video this should not be too difficult. There is also a lot you can do to edit and refine your video once you have a basic mask prepared even if it is not perfect, using other tracking tools inside resolve. You can also export the separated footage with an alpha channel that can be used inside isadora or any other editing software if you want to work with the content further in another application. 

                    Note that this requires some good compute resources, so a high end GPU on windows or a late model mac with Apple Silicon (m1, m2, m3) and good amount of memory. 

                    Fred

                    http://www.fredrodrigues.net/
                    https://github.com/fred-dev
                    OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                    Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                    E 2 Replies Last reply Reply Quote 4
                    • E
                      Eva @Fred last edited by

                      @fredThank you, that's really helpful. Im in the process of testing things and finding out the right solutions, and your details are very helpful:)

                      Eva Esmann Behrens
                      Labtop: Macbook pro (Retina) 2015, 2,7 GHz,8 GB, MacOS Mojave
                      Mac Studio

                      1 Reply Last reply Reply Quote 1
                      • E
                        Eva @Fred last edited by

                        @fred 

                        I will have access to a blackbox where we will record the video, but I only have some hours with them one day. I imagine that asking them to wear something in a color could help. and then I will have to see what happens with the wires, that seems to be the main challenge I remember. I dont have the paid version of DaVinci, but it seems I might have to invest...

                        Eva Esmann Behrens
                        Labtop: Macbook pro (Retina) 2015, 2,7 GHz,8 GB, MacOS Mojave
                        Mac Studio

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post