Can Isadora interface with Realsense Viewer (Windows)?

macjunkee

I appreciate the RealSense cameras over the somewhat cumbersome Kinect cameras, that RealSense cameras seem to communicate so well with Windows' Realsense Viewer, and that Isadora can operate on Windows . . .

That said, has anybody had success culling depth data from RealSense Viewer in Windows 10, and able to use it realtime in Isadora?

If so, can anyone point me in the right direction how to take advantage of the depth qualities and compactness the RealSense cameras seem to offer?

I think there is a way to get Isadora to communicate with other apps on the same computer, but not even sure how to begin pulling appropriate data.

I'm using Realsense Viewer 2.81 and Isadora 3.0.7 on Windows 10 Home, version 1903, with 8GB RAM on an Asus Intel Core i5 (7th Generation).

Thanks,

Christian Michaels

Andy Carluccio

I created such an integration during my undergrad years. Happy to touch base on what I did. Essentially I used openCV and spout.

I used this for realtime projection masking based on depth.

https://www.andycarluccio.com/projection-software

I have some more recent developments with it I could discuss with you as well.

Skulpture

Have you looked at this?

https://troikatronix.com/plugin/openni-tracker/

mark

@macjunkee said:

That said, has anybody had success culling depth data from RealSense Viewer in Windows 10, and able to use it realtime in Isadora?

As @Skulpture said, the OpenNI Tracker actor will allow you to get the depth map image from the Intel Realsense D435 as a video feed. The latest version of OpenNI Tracker (v0.9.8b2) is available at the top of this thread. Note that to work with this version of OpenNI Tracker you must update your camera to the latest firmware, as described in this thread.

Best Wishes,
Mark