• Products
    • Isadora
    • Get It
    • ADD-ONS
    • IzzyCast
    • Get It
  • Forum
  • Help
  • Werkstatt
  • Newsletter
  • Impressum
  • Dsgvo
  • Press
  • Isadora
  • Get It
  • ADD-ONS
  • IzzyCast
  • Get It
  • Press
  • Dsgvo
  • Impressum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    How to mask multiple user from Ni Mate?

    How To... ?
    3
    10
    3051
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • David
      David last edited by

      Hi everyone,

      I'm trying to mask multiple users from a Syphon Feed coming from Ni-Mate.
      I'd like each user to mask a different texture or video as I already did with one user in this piece : [Indicible Camouflage](http://www.davidgumbs.com/index.php?/interactive/indicible-camouflage/)
      I thought it would be simple to try the Color ID mode in Ni Mate and create a user actor that pics up the specific
      ID colour to mask... Well It doesn't seem that simple.
      Do you guys have any idea to achieve this?
      Have a good evening
      David
      1 Reply Last reply Reply Quote 0
      • Skulpture
        Skulpture Izzy Guru last edited by

        Sounds to me like you need a colour tracking system?

        This might help get you started....
        http://vjskulpture.wordpress.com/2012/10/22/isadora-and-colour-tracking/

        Graham Thorne | www.grahamthorne.co.uk
        RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
        RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
        RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

        1 Reply Last reply Reply Quote 0
        • David
          David last edited by

          Hi Graham thanx for your answer and direction,

          this looks interesting but I have no idea how to program does conditions...yet
          It can be indeed very handy. I'm going to search for basics colour tracking tutorials.
          Any insight on triggering after detection?
          1 Reply Last reply Reply Quote 0
          • Skulpture
            Skulpture Izzy Guru last edited by

            I don't think there are many 'basics colour tracking tutorials' i'm afraid. If you find any then please share.

            I did a simple one here: http://vjskulpture.wordpress.com/2010/01/18/simple-colour-tracking-in-isadora/

            Graham Thorne | www.grahamthorne.co.uk
            RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
            RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
            RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

            1 Reply Last reply Reply Quote 0
            • David
              David last edited by

              Yes I remember your's I was just looking at it.

              Thanx...
              1 Reply Last reply Reply Quote 0
              • Skulpture
                Skulpture Izzy Guru last edited by

                Let us know how you get on. From what i've read and from how I interoperate it I believe it is do-able.

                Graham Thorne | www.grahamthorne.co.uk
                RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
                RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
                RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

                1 Reply Last reply Reply Quote 0
                • Fred
                  Fred last edited by

                  This is difficult to achieve easily. I would say you may well be better to use a combination of the normal masks as well as the skeleton tracking. You will have problems when the users cross over each other, but at least the skeleton ids will give you a coordinate reference for the bodys extremes. You could get the head, feet and hands and make a box around them and then display your mask image in that box and use the silhouette to mask that particular user.

                  Getting 4 users reliably in a kinect view is difficult but if you limit the amount they move you will have an easier time. If you also don't let the users cross you will make it much easier. However if you do get users crossing and you are using the skeleton tracking as well you will know which user is in front and hence which to project on.
                  Colour tracking in this case could do the same thing but it is slow and so far in Isadora CPU based. As well as this color tracking is generally done with HSL values, not RGB values. HSL is much easier and faster to analyse as you only really have to get the hue from a pixel, not all the values, tis however as far as I know is not implemented in Isadora.
                  If you can cut the incoming image into 4 slices and separate the users based on their skeleton data you may be on the way to solving this.
                  Fred

                  http://www.fredrodrigues.net/
                  https://github.com/fred-dev
                  OSX 13.6.4 (22G513) MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
                  Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD

                  1 Reply Last reply Reply Quote 0
                  • David
                    David last edited by

                    Hi @Fred,

                    thank you very much for this great explination.
                    Indeed 4 users with the kinect is difficult.
                    I'll try to to first get multiple users info into izzy from Ni-Mate.
                    But I'm not sure how to select the appropriate user's cutout yet.
                    Hum challenging... ;-)
                    I'll keep you posted.
                    David
                    1 Reply Last reply Reply Quote 0
                    • Skulpture
                      Skulpture Izzy Guru last edited by

                      I will be following this with interest!

                      I do hope you get this working. In theory it's all possible - but as @Fred has also said it's difficult to achieve easily. 
                      Please keep us updated :)

                      Graham Thorne | www.grahamthorne.co.uk
                      RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
                      RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
                      RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

                      1 Reply Last reply Reply Quote 0
                      • David
                        David last edited by

                        Sure @Skulpture @fred I'll keep you posted of how it goes.
                        I'm a bit in the flou as we say in french.
                        I'll create a blog post of the process if it's successfull :-)

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post