How to have a person move an object that is generated/projected by Isadora
-
"But with a kinect the edges are of course not just flat; they move and change quite rapidly - as well as having many edges. No idea where to even start with that! "
What are we talking here... the edges of what? What is interacting with what in which direction? I'm only talking using the OSC Skeleton points. I guess you're talking about something in some way interacting with NI-Mate's ghost output/body outline rather than just the simple hand / foot / head co-ords etc?NB: I'm certainly no advocate of Kinect in any massive way - I just happen to have some kicking about to experiment with easily in front of the TV hence working down that route. -
PS: Izzy Interacting with Max... OSC. Think these days pretty much everything talks OSC.
@timeg - what's your website address? Curious to see...! -
@Marci I was talking about the depth image from a kinect. SO the multiple edges are the "outline" of a person.
-
Wow, I got to this thread late in the game.
3D collision detection should be pretty easy in Isadora as long as you have good data.I would be tempted to use 2 IR cameras. One in front and one above.XY from the front, and Z from above. In anycase adding the Z to the Quad detection should be easy.I have only played with rects and circles for detection,but if you want to determine more complex relations I would suggest looking into 'Point in Polygon' detection. see: https://github.com/substack/point-in-polygonSince the number of points in a polygon may vary, it becomes important to pass data sets together (unless you are defining a specific form). It will help keep your patch clean. see: http://dusxproductions.com/blog/pro-tip-single-patchcords-multiple-values/I would think that you could define a dynamic polygon based on the skeleton data that would be close to the actual figure.Then using this 'Point in Polygon' method you should be able to make the collision detections required.Again I would 'fake' the 3D to some extent by make X number of Z regions (just lowering the resolution in this dimension really)Its great to see that my blog has been a help :) -
Some context to my idea/dream
https://www.youtube.com/watch?v=jKB0d9vsfgA -
And here again a unified coordinate system either normalised or pixel based would make comparative calculation and position in Isadora one million times easier.
-
I've found an old patch that @gavspav made for me when talking about this a while ago.
I can't get it to work but it may be handy for some. -
@Fred It's in the feature requests. When you say normalized, what do you mean? I think the precentage measure isadora uses can do the job. It's just knowing which elements are based on stage width vs height that makes calculations difficult. Personally I like the scalability of this method. Using a little care you can make projects that adapt to different displays very easily.
-
DusX and Skulpture,
How to track an infrared LED in Isadora?. I can see an infrared light using Processing and simple open NI tracking IR; it is being picked up by the Kinect. Cannot figure out how to either see and use the IR LED to be tracked in Isadora and then used as a trigger. What would that actor configuration look like? Currently I'm simulating moving particles on the X, Y planes with a Mouse Watcher but would like to replace it with the IR LED as both DusX and Vanakuru suggested. -
infrared camera -> video in watcher -> sprite (to calibrate size and positioning) -> eyes -> gives you an x and y for the infrared dot.
-
Wii remote and OSC, I used years ago, sure it still dose the job.
best ...rainbow -
i don´t quite get your concept. :( the dancer needs to carry the Wii ? -
ofcourse you need a IR led as well for the actor/dancer ;))
-
gapworks- IR led on the dancer. Kinect watches the IR led.
Thanks dbini! I will check out. -
@joedrums
In the link you see a video where an IR-Pen and a Wii-mote are working together, the Wiimote was about 8 meters (26ft) away the maximum distance I could get to work fine. I usede OSCulator to connect to the Wiimote and sent OSC messages to Isadora.
http://www.filmprojekt.ch/theater-installationen/strange-lines/
Best Michel
-
@ Michel would a pen this size work ?
http://www.amazon.de/SALE-Fordex-Gruppe-WIRELESS-PRESENTER/dp/B00KFEPM6I/ref=sr_1_13?ie=UTF8&qid=1444551077&sr=8-13&keywords=IR+Penand how do you connect the Wii with the pen. OSCulator and Osc messages is clear as i used it before.best -
Even later than previous late to party people -
I would approach this by trying to set up sensor/sensors that cover a plane in front of the projection (parallel to the wall where the projection is happening) to detect x y coordinates for anything that breaks the plane.Depending on how many blocks you want, stage size, budget and rigging time you may be able to do it with a series of break beam or distance sensors.If you have serious budget then a laser scanner would be the thing to go for (but test it with expected lighting conditions to see) - cheap 360 laser scanner is http://www.slamtec.com/en-US/rplidar/indexYou would not need full 360 if the laser is on one side or above, but this was cheaper than anything else last time I looked. -
Well done, glade you solved it. ;)
-
No that pen would not work it uses the IR signal to communicate with the usb ir receiver and that is just for sending commands and it has a laser pointer. You need an IR-Pen that has a bright IR-Light. You don't have to connect the IR-Pen with the Wiimote, the Wiimote has a built in IR-Camera and the camera sees the IR-Light.
I have used this IR-Pen the wrong way around, the IR Light was not facing the surface but the Wiimote, I am sure there are cheaper ones around, or you can build your own, there are lots of tutorials online, the trick is to find a very bright IR-LED.
Best Michel
-
