[ANSWERED - TICKET] OpenNI & Orbbec crashes

Vidasonik

@dusx Hi! Unfortunately had little success with Izzy and depth camera during our two shows in Yorkshire.

We have one last chance when we perform in Bradford December 15th so I need to iron out as many problems as I can before then.

I believe I need to connect my two macs via ethernet? I have to use my older mac for OpenNI and send data to the new one (M1 max).

Can you advice what cables/router etc I would need?

Thanks in advance, David

DusX

@vidasonik

Assuming you want to send both skeleton tracking data (OSC) and video data (NDI) you should get a Gigabit ethernet router, and some gigabit ethernet cable (one for each computer). You will also need ethernet adapters for your Macs (if not built-in).

OSC (numbers / text)

You can send the skeleton tracking data via a number of OSC channels, or you can group the values into JSON (using either the JSON Bundler add-on or the Javascript actor) and send each skeleton as a single JSON string. You will then need to use either the JSON Parser add-on or the Javascript actor on the receiving system to unpack the skeleton data values.

NDI (video)

Sending the video via NDI can be achieved by creating a Virtual Stage in Stage Setup for each video stream you want to send and checking the NDI output option on the Virtual Stage settings pane. Then send the video from the OpenNI Tracker actor to one or more Projectors with the virtual stage/s set for the stage input.

You will need the NDI watcher actor from the Add-ons page to bring the NDI video stream into your other computer.

Woland

@vidasonik said:

I believe I need to connect my two macs via ethernet? I have to use my older mac for OpenNI and send data to the new one (M1 max).Can you advice what cables/router etc I would need?

@Juriaan Got any specific gear recommendations for this?

Woland

@dusx said:

OSC (numbers / text)You can send the skeleton tracking data via a number of OSC channels, or you can group the values into JSON (using either the JSON Bundler add-on or the Javascript actor) and send each skeleton as a single JSON string. You will then need to use either the JSON Parser add-on or the Javascript actor on the receiving system to unpack the skeleton data values.NDI (video)Sending the video via NDI can be achieved by creating a Virtual Stage in Stage Setup for each video stream you want to send and checking the NDI output option on the Virtual Stage settings pane. Then send the video from the OpenNI Tracker actor to one or more Projectors with the virtual stage/s set for the stage input.You will need the NDI watcher actor from the Add-ons page to bring the NDI video stream into your other computer.

I already built this setup for @Vidasonik , the only thing left is getting equipment and settings down for a solid network connection.

Juriaan

@woland @Vidasonik

I would recommend a Gigabit router with multicast support for OSC communication between two computers. You could simply pick-up a gaming router, that would work fine. Also, the UI / settings menu is friendlier on those devices than the pro devices that I use in the field.

A Netgear router is a great option for example that can be picked up without breaking the bank. Just make sure that you are on the medium/high-end regarding prizing to get proper support for high bandwidth / multicast support / vLANs.

Pro devices that I personally use;

https://eu.store.ui.com/produc... with an dedicated WiFI access point

Vidasonik

@juriaan Thanks! I'm currently bidding for this on ebay after some advice from Ryan Webber

NETGEAR Nighthawk R7000 AC1900 Smart WiFi Router

I guess i just need 2 standard ethernet cables to connect? Hopefully then I can get some nice smooth curves from the tracked hands of the dancer. The theatre internets I've used I don't think can transfer enough data.

Thanks everyone, David

Vidasonik

@vidasonik but then, of course, I'll have to get a couple of connectors so I can plug into the USB-C sockets on each mac !!

Vidasonik

@juriaan I now have a netgear nighthawk as advised, ethernet cables and adaptors but I don't seem to be able to connect the two macs?

Woland

@vidasonik

You likely need to do this. Unlike the video, you will likely want to disable the wifi.

In the "Depth Camera Listener" User Actor I made for you, you might also need to go to the 'ndi source' input and re-select your NDI source.

Best wishes,

Woland

Vidasonik

@woland I don't have ethernet in my list when I open Network folder in system preferences? I've no idea what to do having spent over £100 on connectors, adaptors and the Netgear Nighthawk!

Woland

@vidasonik

I sent you a message through the ticket system. I may be able to help.

Vidasonik

Finally, I have solved the problem of depth camera not working on my new mac and having to send data to a second computer!

I have dispensed with the Netgear Nighthawk (thank god!) and not needing to connect my two macs at all! I simply connect the orbbec and webcam to my old mac and have a duplicate ableton project on the old one to trigger effects etc. The sound is only sent to Izzy.

The audio on the new mac plays out to pa with live guitar etc. I don't need to send sound to Izzy at the same time because now Izzy is controlled by the old mac. The only issue is the live guitar cannot be used to trigger effects on the old mac (which has the main izzy file which outputs to main projector. The new mac out puts a simple (non-interactive) izzy file to a separate projector.

All I have to do is press the same key on both macs at the same time to trigger the start of the show and proceed through all the scenes together. They are then both running more or less in sync!

It's taken me about 3 months to reach this position!

I have one question though, I can't understand why the orbbec orientation is the opposite of the webcam. That is, the dancers right hand is to screen right with the depth camera (correct) but to screen left with the webcam??

Best wishes, David

Woland

@vidasonik said:

I have one question though, I can't understand why the orbbec orientation is the opposite of the webcam. That is, the dancers right hand is to screen right with the depth camera (correct) but to screen left with the webcam??

Maybe you enabled the 'mirror' input on the OpenNI Tracker actor to flip the depth image?

Vidasonik

@woland Actually no I hadn't. But now I have mirror selected it matches the webcam !!

Another question, I am using an outline of the body tracked by the depth camera with DIFFERENCE actor but when I select COLOUR I only get a red outlined figure despite changing the hue offset with the HSL adjust actor?

Woland

@vidasonik said:

Another question, I am using an outline of the body tracked by the depth camera with DIFFERENCE actor but when I select COLOUR I only get a red outlined figure despite changing the hue offset with the HSL adjust actor?

Try this instead

>>>Example File<<<

Vidasonik

@woland wow - thanks so much! Looks good - Can't wait to try

Vidasonik

@woland For some reason I can't connect to the colour video node (it is faded in grey and says n/a) - only the depth video is accessible?

Woland

@vidasonik said:

I was using a Kinect. I think Orbecc would use the Video In Watcher and Live Capture for RGB video.

Also, I misunderstood. I thought you were trying to use the color video output of the OpenNI Tracker actor.

You can just disconnect the link from 'color video' and link 'depth video' to the difference actor instead.

Vidasonik

@woland - thanks again! I've used your example and changed my User Actor accordingly. Weirdly though, I get colour only when I set DIFFERENCE to GREY! When DIFFERENCE actor is set to COLOUR I just get RED again, as before. But thanks I've got there in the end. And I love the blurr effect ...

Vidasonik

@woland Hi! I'm nearly there with the depth camera now, thanks to all your help. Just fine tuning. One issue that is puzzling me is the distance between the tracked hand and the start of the coloured line. It would be great if the line emanated from the hand immediately rather than there being a delay or gap. I've checked all the settings and can't find where this distance might be adjusted? No big deal anyway. I attach the user actor patch in case you can see anywhere I may have overlooked. Thanks as ever, David