[ANSWERED] ZoomOSC OSC Listener and Arrays

RoccoD

I've been tinkering with ZoomOSC. Pretty neat little application. I see the possibilities. My question concerns the feedback from ZoomOSC to isadora. Specifically the zoom/vid/galorder. ZoomOSC sends this info as an array of the participants IDs from top left to bottom right. Very useful feature for knowing who is where in case you want to auto arrange some captures. How can I access the array in isadora? I've been playing with zoomOSC in node-red and can get that array and play with it easily. How can I do it in isadora? I'm at a loss how to proceed. Thanks in advance.

liminal_andy

Thanks for checking out my app! I do a few things in Isadora with the return info:

Use galorder to set up a list of IDs using OSC Multi Listener
Use galcount as another method of checking when I just need to know quantities
Leverage the above to automatically crop out specific users from the gallery view and simulate them as ISO feeds
Export the ISO feeds as NDI or Spout/Syphon

The Router Actor is really helpful for this. In theory, any actor could occupy any spot in the gallery, so I think about the Zoom gallery as just spaces that could be occupied and then have outputs tied to specific characters. The router uses the information from galorder to determine how to route the video feed of the gallery square to the correct output. I use galcount to set up contingency mappings based on the number of people with video on, so the crop takes place in the correct area.

Eventually I will work on getting this all into a shader or user actor. We've got a lot of ideas for expanding the app to make this easier, but that's how I'm doing it right now.

Would love to hear other ideas!

liminal_andy

This is some ugly thing I did while in a rush but it should specifically answer the question of how to get the array into Izzy. I'm doing some calculations with the numbers as well to get them in a format I want and trigger some events when they change.

and this nonsense is the router system illustrating how any incoming gallery crop could go anywhere (there is probably a better way to do this, but I was rushing)

(bonus points if you recognize the show from the user output actors)

RoccoD

Very slick

RoccoD

Oh. Just saw your detailed post. Makes sense. Thanks!

Woland

@liminal_andy said:

(bonus points if you recognize the show from the user output actors)

I can't read it very well so I'm just going to guess Cats

liminal_andy

@woland said:

@liminal_andy said:

(bonus points if you recognize the show from the user output actors)
I can't read it very well so I'm just going to guess Cats

No bonus points awarded! Top right actor is the hint if you squint hard enough. I only mention it because I'm trying to dig up some production photos to summarize the pipeline as a whole with visuals

RoccoD

@liminal_andy

I'm having an issue with the galorder function. It mostly works, but I've been getting some incorrect data from it.

Participant IDs according to console

012

Gallery Order according to osc message.

012

So 0,1,2 would be Mac Phone Comp according to the IDs

But in zoom the actual order is Mac Comp Phone which is 0 2 1 from top right to bottom left. Any ideas? It seems to only be wrong with 3 at a time.

The issue is repeatable.

liminal_andy

@roccod To confirm (and this is poorly documented so I will fix this), you have ZoomOSC's own video feed hidden, either by having it off or on with "Hide Self View" enabled, and you are hiding non video participants? Are you using meetings or webinars?

RoccoD

I do have hide non video participants on. Right now I'm using meetings but I could use webinar if that is better. I have the webinar upgrade.

liminal_andy

@roccod The 3.1 update comes out next week and adds webinar support, so stick with meetings for now. Are you hiding ZoomOSC's own video? Galorder only works if ZoomOSC's video feed is off or hidden because Zoom will always place you in the top row and mess up the order. Also, the gallery order is specific to what is rendered in the ZoomOSC window and does not reflect the behavior of all windows.

RoccoD

Ah. That makes sense. Yes, I am hiding/unhiding the zoomosc video for testing. I will leave it hidden and just add some other participants to test. Thankyou for the speedy reply.

liminal_andy

@roccod said:

Ah. That makes sense. Yes, I am hiding/unhiding the zoomosc video for testing. I will leave it hidden and just add some other participants to test. Thankyou for the speedy reply.

My pleasure, keep me posted!

RoccoD

It looks like I'll be consulting with Marymount who is getting some training from Liminal so we'll be working together in the future it seems. Also, looking forward to StreamWeaver. It looks like a great product.

Thanks again.

liminal_andy

@roccod Ohh nice, just gave a guest lecture to some staff there. Nice people. I look forward to meeting you!

RoccoD

Would it be possible for a future release to include a bool message for someone sharing their screen?

liminal_andy

@roccod said:

Would it be possible for a future release to include a bool message for someone sharing their screen?

We're looking to do pretty much a full abstraction of Zoom's API to OSC. I brought on additional devs in order to help us make that happen while also getting StreamWeaver out the door (in addition to accelerating our MacOS release timeline for ZoomOSC).

We can almost certainly do the share screen feature, though I would probably implement it as returning the ID of the person sharing screen or -1 if no one is, just so you get a little more information.

Aolis

@liminal_andy

\Tartuffe?!