• Products
    • Isadora
    • Get It
    • ADD-ONS
    • IzzyCast
    • Get It
  • Forum
  • Help
  • Werkstatt
  • Newsletter
  • Impressum
  • Dsgvo
  • Press
  • Isadora
  • Get It
  • ADD-ONS
  • IzzyCast
  • Get It
  • Press
  • Dsgvo
  • Impressum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    Isadora Cues with Leap Motion

    Interfacing
    13
    49
    38453
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dbini
      dbini last edited by

      Armando - nice ideas. Geco is by far the most useful Leap app i've tried. its got some clever little options, like the ability to link open and closed hand values so that you can use open/closed as a switch without the values jumping around.

      OSC out is going to be great.
      10 durable sets of XYZ finger tracking positions would be amazing. Skulpture's right - this opens up a whole new world of interactivity for those with limited movement.
      i'm currently experimenting with using my Leap through Geco into Isadora to control visuals for classical musicians in a similar way to using MIDI controller data from knob-twiddling electronic musicians.
      and making crazy digital mirrors for kids to play with.

      John Collingswood
      taikabox.com
      2019 MBPT 2.6GHZ i7 OSX15.3.2 16GB
      plus an old iMac and assorted Mac Minis for installations

      1 Reply Last reply Reply Quote 0
      • Skulpture
        Skulpture Izzy Guru last edited by

        "My opinion is that it recognize first hand in the field as hand 0 (regardless if it is right or left hand). "

        I totally agree with this! It would be super cool if this was possible.

        Graham Thorne | www.grahamthorne.co.uk
        RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
        RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
        RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

        1 Reply Last reply Reply Quote 0
        • Armando
          Armando Beta Gold last edited by

          It is possible Skulpture, Geco (current midi version) already does it. And I'm sure it is possible since leap people schematized the hands like Kinect people schematized the skeleton (the latter actually stealing the idea from our common friend - with Mark - Antonio camurri that did it with one camera ten years before in Genava Italy EYESWEB.ORG. But that's another story......

          Armando Menicacci
          www.studiosit.ca
          MacBook Pro 16-inch, 2021 Apple M1 Max, RAM 64 GB, 4TB SSD, Mac OS Sonoma 14.4.1 (23E224)

          1 Reply Last reply Reply Quote 0
          • gbevin
            gbevin last edited by

            A small heads-up for everyone. I just submitted the new GECO version with full OSC output support, which includes configurable OSC paths. It also has support now for setting up different boundaries for each gesture axis for each hand, including dead zones around the center. This allows you to plan out gesture ranges in 3D space. There are a bunch of other features (like full CopperLan support), but I don't think they're relevant for Isadora users.

            This release should be available as a free update in the Airspace Store in a couple of days, just the time to go through the Leap Motion verification phase.
            @Armando, thanks a lot for the detailed information about how you see fingers being useful, this has given me quite a few ideas. However, at this point it will not work due to how the Leap Motion software behaves. That being said, I've been working closely with Leap Motion for the next update to their protocol, so that fingers preserve their identity and are much better recognized relative to hand positions. It will take a little while for this to come out and then the required changes to be done in GECO, but it's on the planning. There are some other ideas that this will enable, like for instance triggering actions by touching fingers. I think this will be very nice to launch particular operations or to play notes.
            Thanks a lot for all your kind comments of GECO! :-)
            1 Reply Last reply Reply Quote 0
            • Skulpture
              Skulpture Izzy Guru last edited by

              Thats brilliant @gbevin :) thanks for joining the forum and communicating with us all :)

              Let's see what comes out of it :)

              Graham Thorne | www.grahamthorne.co.uk
              RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
              RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
              RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

              1 Reply Last reply Reply Quote 0
              • vanakaru
                vanakaru last edited by

                Just updated to Maverick to test my new LeapMotion controller(I passed Lions altogether). GECO works very well on new OS X. Very easy to set up Isadora to receive MIDI CC.

                MBP 4.1 & MBP (Retina, Mid 2012) MBP Retina 2017

                1 Reply Last reply Reply Quote 0
                • Armando
                  Armando Beta Gold last edited by

                  Thanks gbevin. I'm looking in the airspace, but I didn't find the new version of geco yet. Do you know why?

                  Anyway I think that discrete hand recognition is possible due to the geometry of hands (thumbs in afferent angle than other fingers).
                  Can't wait to see it.

                  Armando Menicacci
                  www.studiosit.ca
                  MacBook Pro 16-inch, 2021 Apple M1 Max, RAM 64 GB, 4TB SSD, Mac OS Sonoma 14.4.1 (23E224)

                  1 Reply Last reply Reply Quote 0
                  • gbevin
                    gbevin last edited by

                    @armando Leap Moton is overbooked with app submissions, they're looking at my GECO submission as we speak and hope to have it done in a few hours.

                    1 Reply Last reply Reply Quote 0
                    • gbevin
                      gbevin last edited by

                      @armando the update is live now :-)

                      1 Reply Last reply Reply Quote 0
                      • dbini
                        dbini last edited by

                        hi Geert @gbevin - the new version of GECO is great. I like the boundary controls.

                        One feature I would like to see is the possibility of swapping the X axis from 2 separate fields into one field with zero at one end and 100% at the other. 
                        Currently, we have zero in the middle of the axis, with the left hand generating higher numbers the further left it travels, and the right hand generating higher numbers the further right it travels.
                        It might be useful to have the option to make the left end of the field zero and the right end 100% - or to swap them around - this would make it easier to recognise swipe gestures that are applicable to either hand. i'm thinking of something like a museum exhibition (@Skulpture) where users can swipe through information by waving either hand over the LEAP.
                        Its not really an issue with the Y and Z axes, they each function as one field, so its easier to set up a calculation to work out which direction a hand is travelling, but i've had trouble doing this with the X axis.
                        all the best,
                        john

                        John Collingswood
                        taikabox.com
                        2019 MBPT 2.6GHZ i7 OSX15.3.2 16GB
                        plus an old iMac and assorted Mac Minis for installations

                        1 Reply Last reply Reply Quote 0
                        • Armando
                          Armando Beta Gold last edited by

                          Thanks gbevin. I'm looking into it as we speak. Detailed report soon.

                          Armando Menicacci
                          www.studiosit.ca
                          MacBook Pro 16-inch, 2021 Apple M1 Max, RAM 64 GB, 4TB SSD, Mac OS Sonoma 14.4.1 (23E224)

                          1 Reply Last reply Reply Quote 0
                          • N1ckFG
                            N1ckFG last edited by

                            I've added Isadora channel support to my Leap OSC controller, ManosOSC--just change the format type in the settings:

                            https://airspace.leapmotion.com/apps/manososc/
                            1 Reply Last reply Reply Quote 0
                            • vanakaru
                              vanakaru last edited by

                              N1ckFG

                              I had a run with it for couple of hours. I like the ease of getting it going. Great app!

                              MBP 4.1 & MBP (Retina, Mid 2012) MBP Retina 2017

                              1 Reply Last reply Reply Quote 0
                              • particlep
                                particlep last edited by

                                has anyone used geco's o-s-c output with isadora ?

                                i've left a post on the geco forum about not seeing any o-s-c output other than 5 stream id's when enabling o-s-c output. 
                                i'm using local host and the isadora port number in the geco document settings panel.
                                i'm in a place where i'm not sure if it's my bad driving or something wrong under the hood with geco.

                                isadora v3.0.7
                                mbp 2.6ghz i7
                                mac osx 10.12.6
                                dyslexic.

                                1 Reply Last reply Reply Quote 0
                                • particlep
                                  particlep last edited by

                                  i'm happy to report that the fault was with the operator.

                                  in the gesture config window the output channel holds the 1-16 for midi and then o-s-c and then cpl. this is also covered in geco's user manual.
                                  my investigations had simply missed these two bits of info.
                                  everything is fine and dandy.

                                  isadora v3.0.7
                                  mbp 2.6ghz i7
                                  mac osx 10.12.6
                                  dyslexic.

                                  1 Reply Last reply Reply Quote 0
                                  • Armando
                                    Armando Beta Gold last edited by

                                    Hello,
                                    recent and today's update in leap motion drivers leads us to some thinking in order to help Gego and other middleware to get data into Isadora (although an izzy actor in c would be the ideal thing because software like geco is using 27 % of an intel 2.7 ghz i7 with 16gb of ram under Maverick.)
                                    Now. Geek osc version is just great we can write our own tags!
                                    But the new version of leap motion driver is really stunning for a few reasons.
                                    1) Leapmotion visualizer seems to overcome somehow crossing hands. If you switch hands horizontally your right hand is now left of screen but it is the right hand. And same for the left of course.
                                    2) Turning a hand bottom up doesn't mixes fingers!!!! If you out right hand hand palm up now the thumb is in the right place.
                                    3) And even better, It seems to be able to recognize what hand is in the field even if the hand is bottom up!!!!! Wow! Hands right thumb is still right thumb on screen even if right hand enters on the left end of the sensor's field of vision with palm up!!!!!!! I can see this because if I do this geco's right hand valus start to trigger.
                                    Geco has a clever way to to this called dexterity detection. And it is good it stays that way for precision. But now everything seems right just out of leap driver.
                                    In my opinion this means that leap people ttought the driver to recognize hands geometry in order to detect which it is and if it is bottom up or normal palm down.
                                    As for geco I would suggest an option that ignores if fingers are open or closed. It would be just a “palm orientation” feature because otherwise you always have to be with spread fingers and cannotrelax or the contrary. Now, this can be avoided in geco addressing open and closed fingers to the same osc tags or midi channel and controller and then “linking the 2 modes (spread and closed) with the linking chain in geco. But it is quite a bit of work…
                                    Now I’m dreaming…. And if geco could also receive midi or osc and have different preset in a same document. We could hand or sensor trigger diferent presets for different moments or funcions of the installation….. Maybe version 2?
                                    Best

                                    Armando Menicacci
                                    www.studiosit.ca
                                    MacBook Pro 16-inch, 2021 Apple M1 Max, RAM 64 GB, 4TB SSD, Mac OS Sonoma 14.4.1 (23E224)

                                    1 Reply Last reply Reply Quote 0
                                    • First post
                                      Last post