• Products
    • Isadora
    • Get It
    • ADD-ONS
    • IzzyCast
    • Get It
  • Forum
  • Help
  • Werkstatt
  • Newsletter
  • Impressum
  • Dsgvo
  • Press
  • Isadora
  • Get It
  • ADD-ONS
  • IzzyCast
  • Get It
  • Press
  • Dsgvo
  • Impressum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    Kinect for background subtraction

    How To... ?
    7
    35
    19676
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jhoepffner
      jhoepffner last edited by

      Armando,

      Yes the Kinect One is named V2 by the super-geeks…
      Salute

      Jacques Hoepffner http://hoepffner.info
      GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
      MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
      MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
      MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2

      1 Reply Last reply Reply Quote 0
      • E
        eratatat last edited by

        @jhoepffner , thanks for your post. It would be amazing if you could let us know when you're ready with the app.

        1 Reply Last reply Reply Quote 0
        • E
          eratatat last edited by

          @Dusx, I'm working on a mac. Thanks anyway.

          1 Reply Last reply Reply Quote 0
          • jhoepffner
            jhoepffner last edited by

            Hello,

            I can post the actual state of app.
            Inside the .zip, you have the folder containing the processing project (too heavy to make an app…), you need:
            – Processing 2 or 3

            – last syphon library (Processing website)

            – last OscP5 library (")

            – last Open Kinect For Processing library (")

            You need to install some libraries on your computer (see here http://shiffman.net/p5/kinect/)

            There is also a Isadora patch, to receive depth image and RGB image, adjust the settings for depth and a scene with sample of alpha masking.

            Quite rough but it works, for me on MacOs 10.10 with Isadora 2.5, Processing 3 and kinect V2 (kinect One with windows link). It can works with V1 if you modify some parameters.

            Fell free to give me feedback.

            jacques

            6c309c-testkinectv2depthmask03.zip

            Jacques Hoepffner http://hoepffner.info
            GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
            MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
            MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
            MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2

            1 Reply Last reply Reply Quote 0
            • E
              eratatat last edited by

              @jhoepffner thanks for sharing this, 

              it works! great work.
              I am trying to see whether it's possible to work directly with the registered image, to avoid bringing out two separate syphon instances. I can send the image through, but can't seem to work on the threshold of the depth data. Also, on the registered image the depth pixels are slightly off and not sure how to fix it.
              1 Reply Last reply Reply Quote 0
              • E
                eratatat last edited by

                @jhoepffner p.s. got the kinect V2 now. 

                1 Reply Last reply Reply Quote 0
                • E
                  eratatat last edited by

                  Or perhaps, use a blend more directly in processing, I've tried it but can't seem to make it work. Sorry, really new to processing, so haven't figured out the logic yet.

                  thanks!
                  1 Reply Last reply Reply Quote 0
                  • DusX
                    DusX Tech Staff last edited by

                    If anyone would like to try/test this

                    https://github.com/rwebber/kinect2share
                    Please do and let me know how it goes.

                    Troikatronix Technical Support

                    • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                    • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
                    • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

                    Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                    1 Reply Last reply Reply Quote 0
                    • Skulpture
                      Skulpture Izzy Guru last edited by

                      Thanks Ryan. I am going to ask the dumb question here, but when I download something from github it comes a zip. When I unzip it its always just lots of files and code like documents. Am I doing something wrong; or should this be an application ".app" ?

                      Graham Thorne | www.grahamthorne.co.uk
                      RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
                      RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
                      RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

                      1 Reply Last reply Reply Quote 0
                      • DusX
                        DusX Tech Staff last edited by

                        The 'release' zip has the app 'exe'. This is windows only.

                        The izzy sample file is in the code files... I need to update that... i forgot to add it to the release.

                        Troikatronix Technical Support

                        • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                        • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
                        • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

                        Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                        1 Reply Last reply Reply Quote 0
                        • Skulpture
                          Skulpture Izzy Guru last edited by

                          Thats ok. Just wanted to check.

                          Graham Thorne | www.grahamthorne.co.uk
                          RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
                          RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
                          RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

                          1 Reply Last reply Reply Quote 0
                          • E
                            eratatat last edited by

                            Hi there,

                            do you know if there is an alternative for MAC to Daniel Shiffman's library in processing?
                            While testing the file [@jhoepffner](http://troikatronix.com/troikatronixforum/profile/jhoepffner) I got an error, processing cannot find the device (kinect v.2). 
                            It seems like mac and kinect v.2 are not working well. 
                            Any suggestions how to solve this?
                            Thanks
                            1 Reply Last reply Reply Quote 0
                            • E
                              eratatat last edited by

                              Hi there,

                              do you know if there is an alternative for MAC to Daniel Shiffman's library in processing?
                              While testing the file [@jhoepffner](http://troikatronix.com/troikatronixforum/profile/jhoepffner) I got an error, processing cannot find the device (kinect v.2). 
                              It seems like mac and kinect v.2 are not working well. 
                              Any suggestions how to solve this?
                              Thanks
                              1 Reply Last reply Reply Quote 0
                              • jhoepffner
                                jhoepffner last edited by

                                Hello,

                                I you follow the procedure of libraries install (as described in Shiffman post, mainly freenect), it will work well.
                                some things to note
                                – you need a USB3 connection
                                – sometime you need to unplug/replug the kinect
                                – kinect V2 on mac gives you rawDeep info, color image, IR image but no skeleton infos.
                                I used it on a an installation one month ago, Processing to Isadora to Processing, no problem.
                                https://vimeo.com/194632092
                                I do not know of other working kinect Processing library on mac.
                                Millumin is able to have skeleton infos on mac but no way to output the info to Isadora…
                                Hope that helps

                                Jacques Hoepffner http://hoepffner.info
                                GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
                                MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
                                MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
                                MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2

                                1 Reply Last reply Reply Quote 0
                                • DusX
                                  DusX Tech Staff last edited by

                                  I have made a few updates to this app:
                                  https://github.com/rwebber/kinect2share
                                  It now outputs the Hand state (is the right or left hand open or closed) as well as a number of other small things.

                                  The black and white mask (silhouette) is available via spout by default, as well, the 'green screen' type feed is there, incase you want live background subtraction.

                                  Troikatronix Technical Support

                                  • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                                  • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
                                  • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

                                  Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                                  1 Reply Last reply Reply Quote 0
                                  • E
                                    eratatat last edited by

                                    @jhoepffner the problem I got with Shiffman's library does happen, I don't know why and how, this has developed into an unsolvable mystery.

                                    https://github.com/shiffman/OpenKinect-for-Processing/issues/80
                                    A couple of questions below, if you have the time, I would really appreciate your feedback.
                                    I will be using windows instead with the other two libraries, can I ask you, will your processing patch work with the other processing libraries? 
                                    Also, I will be compositing the final video on Resolume, so I was thinking of sending the image from Isadora to Resolume via Syphon. Is it possible to keep the alpha values intact when importing the syphon image to Resolume. 
                                    A huge thanks for your help. 
                                    1 Reply Last reply Reply Quote 0
                                    • E
                                      eratatat last edited by

                                      @DusX thanks for sharing. As I'm totally new to windows, I'll ask you something a bit dumb, what do I have to do to run this app? 

                                      1 Reply Last reply Reply Quote 0
                                      • jhoepffner
                                        jhoepffner last edited by

                                        @eratatat

                                        – first question: I am more accustomed to MacOs, but I use windows on Bootcamp and I tried Kinect on W and M, with Processing and Touch Designer. For what I see it's much better implemented in Windows and with Windows Processing Kinect Library, you can obtain directly a mask to make background replacement. But you have to struggle with Spout who is less easy to use that Syphon (DirectX dependent, Graphic card dependent…).
                                        For my actual usage (https://vimeo.com/194632092) I use Processing and Isadora on MacOs with Syphon to pass image in both ways).
                                        – To use my patch with other library, you have to change all what is related to the library and I dont know how to obtain "getRawDepth"
                                        – For the second question, if you use Windows, you dont use Syphon but Spout… Concerning Syphon, if you declare your background in Processing with alpha mask (as color(0, 0, 0, 0), you send alpha with Syphon but I dont know about Resolume and Spout…
                                        In Millumin you have a quite easy way to obtain alpha mask from Kinect, give a try to the beta release.
                                        Jacques

                                        Jacques Hoepffner http://hoepffner.info
                                        GigaByte 550b / Ryzen 7 3800X / Ram 64 Go / RTX 3090 24 Go / SSD 2 To / raid0 32 To
                                        MBP 13' i5 2.6 Ghz 16 Go / Intel Iris / macOs 10.11.6 / izzy 2.6.1 + 3.0.3b2
                                        MBP 15' i7 2.6 Ghz 16 Go / GTX 650M 1Go/ MacOs10.13.3 / Izzy 2.6.1
                                        MSI GS65 i7 3.6 Ghz 32 Go / GTX 1070 8 Go / Windows 10 / Izzy 3.0.3b2

                                        1 Reply Last reply Reply Quote 0
                                        • DusX
                                          DusX Tech Staff last edited by

                                          @Eratatat Download the release (un zip it) And open the exe/application file. All required libraries are included. Note: both syphon and Spout support transfer of video with alpha. This image shows the alpha cutout video inside the openframeworks app and inside Isadora. https://camo.githubusercontent.com/bfeb9fa759cc5f984491d0daecd84cd878211521/68747470733a2f2f73636f6e74656e742d79797a312d312e78782e666263646e2e6e65742f762f74312e302d392f31343532303535355f3632383434313634373332363639395f323030393038363034333338343439333735375f6e2e706e673f6f683d3133626138383034353261333531393363386264666163646161643639363365266f653d3538414333354633

                                          Troikatronix Technical Support

                                          • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                                          • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
                                          • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

                                          Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                                          1 Reply Last reply Reply Quote 0
                                          • E
                                            eratatat last edited by

                                            @DusX
                                            I'm sorry I can't find the release zip. I download the zip folder from github. Nothing there.
                                            Is there a way to calibrate what bit we take from the depth data? I'd like to do quite a detailed background subtraction.
                                            Many thanks

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post