Isadora Cues with Leap Motion

Skulpture

One on gumtree for £50 too.

Armando

Dear dbini,

sorry I don't get one thing you say. "I'm trying to find time to build a Geco watcher in Izzy. But doesn't Geco send midi out? If so (I'm still waiting for my leapmotion, so I might be saying something stupid here) why do we need a geco watcher in izzy? We could simply have direct midi. Isn't it?

Thanks

dbini

Armando - indeed, you are right: Geco sends midi data out according to a set of gestures (eg: horizontal movement of left hand closed fingers will send 0-100 on one channel, vertical movement of right hand splayed fingers might send 0-100 on a different channel - they're all assignable)

i'm planning to build a patch that has various midi watchers laid out in a similar format to the Geco UI: so that if i label my midi channels sequentially in Geco, the Izzy patch will have all channels labelled with the associated gesture. just to make life easier.

or you could just have one midi watcher and work out what it does by using it.

Armando

Ahhh Thanks a lot. I was afraid it wasn't a normal midi soft. Great. i'll buy it. Iwould have preferred OSC though. Like that. I'll test as soon as I get my leapmotion

[LeapToOsc_osx](https://github.com/N1ckFG/LeapToOsc/blob/master/bin/LeapToOsc_osx.zip)

Skulpture

Managed to get one. Good old eBay got me a week old one for £40... will be exploring this over the next few weeks! Hopefully I can share some stuff back. Cheers.

Armando

Good catch Grahm. Just found leaptosc app and the brand new oscmotion. They both work well But some things are missing (maybe we can convince the developers to implement it. I need (and no one has it in the leap osc apps) hand orientation.....

particlep

i"m interested to learn about the range of the leap motion controller, how far from the sensor can the hand gestures be?

Skulpture

From what I can see @particlep it creates a dome like shape above the device which can extend up to 22cm high.

Skulpture

OSCmotion is brilliant (Thanks @Armando!) It's really easy to use and Isdaora picked it up right away.

stefanino

Hi!

also for me is very good OSCmotion! :)

I'm experimenting and it seems very useful to me

particlep

@Skulpture thank you for the info. i'm certainly interested in this little device. i wait to hear more.

jgastonraoul

Hello !

I managed to make my leap working with LeapToOsc. What are the benefits of OSCmotion over LeapToOsc ?

Armando

Well I didn't compare thoroughly but

In theory Leaptoosc seem to recognize each hand individually (each hand has one integer and three floats)

fingers are labelled 0 to 4 with each fingers having 2 integers (don't understand why) and 3 floats. This appears in But in fact the probles of recognize.

In reality this is not true hand is not recognized by shape, First hand that enters is hand 0 and second is hand 1 (despite being right or left.

OSCMOTION doesn' even recognize hand just 10 fingers (30 parameters total)

For the moment although I love osc much more than midi.... I'll stick to GECO that has hand orientation (yaw pitch roll and this with open fingers AND close fingers as diferent types of hand orientation). This also great because Isadora has a specific yaw pitch roll actor that works like a charm...... The best thing is that Geco goes OSC....

Fred

I was curious about leap but some developer friends had a few and I decided against it (poor condition requirements and limited performance). I just checked out the SDK a little more and it gives quite a bit of information, including precise rotations of each hand. Sending all this via OSC is very simple. If someone is really keen I can make this but you have to lend me a leap in Amsterdam so I can test it.

Fred

Armando

Please give a look to geco too. It is midi unfortunately but mapping is easyer than o/c. You don't have fingers but you have hand 6 degrees of position and rotation (x, y, z position + pitch yaw and roll of hand) and at the moment no leap osc app can do that. On the contrary geco doesn't have individual fingers x, y and Z position. We definitely need both: fingers and hand position orientation. I'd love to lend you mine fred but I'm usigng it a lot.....

gbevin

Hi everyone,

I'm the programmer of GECO and stumbled onto this thread while doing a Google search.

The next version of GECO is going to have OSC output and I should be done with it the latest by next week. It's interesting to hear that you find it important to have access to the finger data as well as the hand data. Would it be possible to give me an idea how you would use these together? It might give me some ideas for future improvements.

Take care,

Geert

Skulpture

Hi @gbevin great to have you on board.

In response to your question about finger data I can only answer with a prediction and personal slant. The Isadora software is used in such a wide content; its not just a media server, VJ program or theatre/dance playback, people use it for all sorts of weird and wonderful stuff.

As an admin and pro user of the software I read so many wonderful projects from people all over the world and to explain why people would want access to the finger data could be the length of my arm. I am sure people will reply individually to give you a better idea.

One area that is interesting for me is the disability/accessibility realm. To allow a disabled person to paint digitally just using one finger would be great. This can be done using isadora for the graphical part.

Another is being able to pinch and zoom and use individual fingers for individual tasks, etc. Hard to explain really. Finger 1 = projector brightness 1, Finger 2 = projector brightness 2, and so forth.

I hope this helps a little.

Graham (skulpture)

particlep

i"ve taken a leap into this arena ( intentional pun ) my leap motion has arrived today. i have some ideas caentred around a gallery experience. as i begin my research i"ll be looking for the variability of the relationships between ... for example the tips of the fingers and the heel of the hand. i have some os upgrading work to do first.

Skulpture

Ace! Do let us know how you get on @particlep :)

Armando

Dear Geert,

thank you for your wonderful software. I bought it immediately and I use it with pleasure. I can tell you and we all can, I tink in this forum, give some feedback on it.

Since you ask I think that passing geco to osc is a great move. Having floats instead of 0-127 integers that midi uses allow more steps and smoothness to interactions. This would be my first option although we all understand that midi is essential for music because it is a standard. But Ableton live customers now have access to o/c through max for live so I think these users will appreciate.

Ok why fingers. Not only drawing but more accurate control of music parameters. A multidimensional one. For instance controlling 3 parameters with 3 fingers and 3 others with hand.

and also introducing gestures (distance between fingers cans be calculated in Isadora and be another parameter...

Second thing is fingers. I think it is important to add the 30 parameters that represent X,Y and Z position of each finger. But it has to be done in a certain way I think personally.

1) separate x, y, z position of each fingers

2) (very important) recognize each hand individually as right and left (as you already do in geco)

First comment: "Leap to osc" is not a good example in this. What it does WHICH IS NOT GOOD IN MY OPINION is that it recognize first hand in the field as hand 0 (regerdless if it is right or left hand). For example if I have left hand only in the leap camera field it is "hand 0". But if I take it out and enter the right hand it is still hand zero. Geco recognizes right and left hand separately. Very good point for geco

Second comment: "Osc motion" doesn't even have hand information just x,y,z for each finger

3) (very important too) Recognizing each finger individually based on the position in relationship to the each hand. This means being able to always recognize the left thumb as left thumb, left index as left index, etc. and also different from right index and right thumb of course.

First comment: "Leap to osc" send x,y,z floats for each finger but it recognizes the first finger as finger 0\. the second as finger 1\. regardless of what finger it is in realtionship with the hand. Very confusing. If I enter the leap camera field with left hand the software should detect left hand and send a integer (1) for left hand presence (as geco already already does even if it sends a 127 for obvious reasons). And it should also send x,y,z for each finger. Now What would really make geco stand up, is that if I close all fingers but one (like index for instance) i should still have x,y and z values for the index. and keep these values going on for the index even if I unfold a second finger (like thumb). Now if I fold index and keep the thumb unfolded and moving, I should have thumbs coordinates flowing. Basically we need finger recognition as you already do hand recognition.

Second comment : "Osc motion" has the same problem that "leap to osc" have. finger 1 is the first finger regardless of what finger it is.

I'D LOVE to see that in geco..... I can thoroughly test that if you want. You can write to me privately to if you want. a.menicacci at me.com

All the best and keep up the beautiful work Geert. I Love Geco