I just found a tool I think you'll love that was given me by the author. Colin Clark, an incredible person, a composer and software developer (and much more !) based in Toronto. He created a software called Movement OSC, (mac PC and linux) that does pose estimation and sends osc. It can also compare Movenet and MediaPipe so you can compare them ! The software formats the osc messages 4 ways Bundeled messages per axis, messages per axis, and bundled xyz array. I use just the latter then parse it in the Json parser 

Here are the keypoints and the keypoints diagram 

Enjoy !

0: nose
1: left_eye
2: right_eye
3: left_ear
4: right_ear
5: left_shoulder
6: right_shoulder
7: left_elbow
8: right_elbow
9: left_wrist
10: right_wrist
11: left_hip
12: right_hip
13: left_knee
14: right_knee
15: left_ankle
16: right_ankle
17: left_eye_inner
18: left_eye_outer
19: right_eye_inner
20: right_eye_outer
21: mouth_left
22: mouth_right
23: left_pinky
24: right_pinky
25: left_index
26: right_index
27: left_thumb
28: right_thumb
29: left_heel
30: right_heel
31: left_foot_index
32: right_foot_index

Keypoints diagram

Anyone having success using a motion/depth sensor camera for a gallery installation that is native to or at least works very well with MacOS? I would prefer to use Isadora over TouchDesigner, but every camera I look into seems to run into issues with compatibility. Looking into Orbbec Astra 2 or Mini now but would be very grateful for recommendations (and success stories)! I am an artist and am new to this motion/depth sensor tech but highly motivated to figure it out. Currently on an Intel Mac but may upgrade to Silicon sooner rather than later if that makes a difference.

Thanks in advance!

@trevor said:

a step on the cue sheet

 Are you using 'Cue Sheets' or are you referring to 'scenes' as cues?

If you are talking about Scenes, you can add a 'Jump' actor with a relative setting of -1, connected to a keyboard watcher. This will move you back 1 scene.
Or, open the 'Edit Go Triggers' dialog from the 'Scenes' menu, and assign a Go Trigger (keyboard, MIDI, or HID) to the 'Previous Scene' direction. This will apply to the entire show, while the Jump actor needs to be added to each scene.

If you are using the 'Cue Sheets' feature, you are able to send keyboard commands to the scene as define in the Cue Sheet Editor. These allow for what you can think of a sub-cues within a Scene. Now if a Cue is triggered, it could do all sorts of things, including starting timed operation, looped operations or interactive controls. It isn't practical to be able to step backward in the cue sheet since there is no clear definition as to what 'rewinding' would be. You can however, build some form of step back into your patch, that resets things to certain configurations, however this is very much a custom approach.
If you are unfamiliar with Cue Sheets, you can watch an introduction here: Working With the Cue List Editor and Cue Sheets

How do you step back a cue. In other words, if you inadvertently trigger a step on the cue sheet, how do you step back one cue at a time.

For example:

There are five cues in a scene, triggering various functions

I accidently trigger Q3, how can I get back to Q2 without opening the cue sheet?

Of course, I can easily step back to the previous scene, but not a previous cue.

Thanks for your help.

@lwebster said:

@citizenjoe That is so strange! I wonder why that happens with some Dell models? Unfortunately I don't have permission to download programs without IT (they're very strict) so I can't re-encode it to HAP with Shutter Encoder (at least not right now) - could I try a different codec that I could export from AfterEffects, or do you have an alternative re-encoder I could try?

 You may not be able to do this without IT, but you can install the HAP codec for Adobe Creative Suite and do it direct. For the sake of trying it, could you convert the media files on a different computer? 

You can try H264 if you're not working interactively with the files. Look at tips 5, 6 and 7 here: Hot Tips to get the Best Performance from Isadora : TroikaTronix for further ideas.

Also here: Create Windows Native HAP avi Video Files : TroikaTronix

For the record, my machine works REALLY well with Isadora and I do have the A4000 GPU running independently of the integrated graphics!

Cheers,

Hugh

@citizenjoe That is so strange! I wonder why that happens with some Dell models? Unfortunately I don't have permission to download programs without IT (they're very strict) so I can't re-encode it to HAP with Shutter Encoder (at least not right now) - could I try a different codec that I could export from AfterEffects, or do you have an alternative re-encoder I could try?

@mark_m Thanks so much for your help. I couldn't do that in BIOS, and though I found it in device manager, I need admin permissions to disable it. I can ask my IT department if they'd be willing to disable it tomorrow.

I'm not sure if the other university laptop has multiple GPUs, but my personal laptop at home does. I also have that one set to default to NVIDIA for Isadora, but I didn't disable the intel GPU on it.

@lwebster

I'm on basically the same machine as you and any time I've had a problem like this, it's been the video codec. Maybe try re-encoding the video with Shutter Encoder? Use the HAP codec - any of the wrappers will do. Note that this will make the video unplayable in windows media player, but VLC will work.

Cheers,

Hugh

@dusx Thank you so much for the help. Unfortunately no luck, I disconnected all external displays and it was still spiking up to 180% with a keyboard watcher connected to a colorizer.

@lwebster

It's possible you are running video through the Intel GPU, by using certain plugs. 

On many laptops some video ports connect direct to the Intel GPU while others may connect direct to the dedicated card. Unfortunately not all machines handle this as smoothly. Some introduce significant bottlenecks while others can use both rather quickly.

Try detaching any external displays, and see if that speeds things up. The Load should drop instantly if this was the issue.