@bonemap a lot - if not most of the ML models are fine with black and white images - ie IR video (as is used by the TOF and structured light cameras you mention) - however you will need to provide the light source and the camera stream that can see the IR lit subjects - no pixels is no information. Kinect etx have their own light source - which of course you can use and feed into these models (ie a kinect IR video stream)- this may be a better approach than feeding the images into openNI which is essentially a dead outdated hack.

Not sure what Ml model you are using but there are many and this is a good one: https://github.com/MVIG-SJTU/A...

Fred

I have posted a 'rough cut' of a tutorial video on setting up Pythoner to work with MediaPipe to my personal YouTube channel. 

Please let me know if you find any issues, or feedback regarding clarity etc.. I will do a round of updates to the video before making it available officially on the Troikatronix YT channel. 

Attached here is an Example file (used in the video, but now updated).
Again, if you have suggestions to improve this let me know (it is meant as a starting point).


NOTE: Pythoner has the ability to use 3 different configurations for which python environment is used.
I will make a video to walk thru these and their pros and cons soon.
In this video, I focus on the global virtual environment setup Isadora supports. 
The other options are a Local (to the project root) Virtual Environment, and the default environment included in the Pythoner actor (the most portable option, but limit in features).

@bonemap I think the best solution right now is https://www.move.ai/ BUT disguise has got its hands on it. So the price is high... unfortunately. 

@fred said:

@skulpture your signature has more windows than mac so here are a few possible tips. 

Use always up https://www.coretechnologies.c... to run Isadora as a service - you can lock out other apps kind of a kiosk mode when there isnt one

This looks intersting thank you. I use one called 'Restart on Crash' it kept a museum install going for over a year for me. The one you have suggested look way better. Thanks.

Next - to hide the toolbar - you can use the overscan settings for your monitor - not the best solution, but it basically zooms in on the output using your GPU - no overhead and no real settings - once it is set for a screen it should just remember it.

A good idea - I will consider it. But I think I am goin gto use the stage output and use the stage mouse watcher. 

last - not sure if this is appropriate but if you switch to using a touch screen and disable as much of the keyboard assist as you can (not 100% possible in windows but you get close), and then re calibrate with the over scan you get a pretty convincing kiosk like display.

We are using a 'proper' touch screen kiosk - I am not sure on the make/model but its one of those portrait ones you see in museums/train stations, etc. It has a built in computer with decent spec. 

Last - lots of extra work, but a cool option an OSC browser based control panel - https://github.com/colinbdclar... this library will let you use web based UI elements that send and receive OSC - chrome has an excellent kiosk mode that works well on most OS's and perfectly on Linux - this means you can run just about any old trash machine to do your UI and pass it on to Isadora.

Brilliant will look at this too. If not for this project I am sure it will be handy. At a glance it seems similar toOpen Stage Control and OSCAR 

As always thanks @fred. 

@skulpture your signature has more windows than mac so here are a few possible tips. 

Use always up https://www.coretechnologies.c... to run Isadora as a service - you can lock out other apps kind of a kiosk mode when there isnt one.

Next - to hide the toolbar - you can use the overscan settings for your monitor - not the best solution, but it basically zooms in on the output using your GPU - no overhead and no real settings - once it is set for a screen it should just remember it.

last - not sure if this is appropriate but if you switch to using a touch screen and disable as much of the keyboard assist as you can (not 100% possible in windows but you get close), and then re calibrate with the over scan you get a pretty convincing kiosk like display.

Last - lots of extra work, but a cool option an OSC browser based control panel - https://github.com/colinbdclar... this library will let you use web based UI elements that send and receive OSC - chrome has an excellent kiosk mode that works well on most OS's and perfectly on Linux - this means you can run just about any old trash machine to do your UI and pass it on to Isadora.

@armando

Hi @armando,

I have also been following these developments for years and have Mediapipe running in Isadora through the Pythoner plugin. I have hand tracking, face tracking and pose tracking variations as separate Pythoner patches. There has been a fair bit of upkeep to these patches and the upgrade of patches with new versions of Mediapipe, Pythoner and Isadora. This has meant reinvesting in the integration with Isadora over time. 

The BIG QUESTION for me using flat RGB video for these new AI and ML approaches is that they do not allow me to track performers in a theatrical setting - this means in lighting conditions that are not optimum for capturing the body as an RGB image - for example n darkness. It remains critical that body tracking for performance is optimised as agnostic to reflected light ie: works in darkness or with a variety of lighting and projection sources. AI and ML tracking has not proved itself in theatrical performance because it requires the tracking subject to be clearly represented in a video stream.

Structured light devices - like the Kinect and OoenNi variations are still important precisely because they operate without a visible light source illuminating the tracking subject.

But please, if there is an AI or ML solution that works in darkness without visible light, I would love to know about it!

Best wishes

Russell

@dusx Yeah... not what I'm after. Been looking at scripting but there isn't a 'proper' way to do it. My approach is going to be using the stage and faking it. It will work but adds other complexities. 

@skulpture

I believe the closest we can offer right now, is to save the file 'password protected'.

@skulpture said:

 I'm back at this problem again a few years down the line. I am exploring how to set up a kiosk-style interface for a high-profile installation. The control panel would work perfectly for this; especially with the new feature of V4.0.9, but I need full screen with no top bar - kiosk style and I don't currently know how to do this, or if it's possible at all. Any ideas/developments welcome. 

In notch you can load a file into the command line and add "+windowed 1" after the file directory and it loads full screen. Something like this would be perfect.

@dusx Thanks! Gave it a try at 6 / 8 / and 11 — still crashing the movie players around 15 minutes into the cycle. I truly don't understand what changed.