@agentsimon2

Currently the only officially supported format for 3D files is .3ds, but @DusX might be able to come up with something using Python.

Hello all, I just found a tool I think you'll love that was given me by the author. Colin Clark, an incredible person, a composer and software developer (and much more !) based in Toronto. He created a software called Movement OSC, (mac PC and linux) that does pose estimation and sends osc. Movement OSC detects body keypoints using Tensorflow.js' MoveNet models and sends data over OSC. It can also compare Movenet and MediaPipe so you can compare them ! The software formats the osc messages 4 ways Bundeled messages per axis, messages per axis, and bundled xyz array. I use just the latter then parse it in the Json parser 

Here are the keypoints and the keypoints diagram 

Enjoy !

MovementOSC provides a normalized keypoint format that is consistent across all its supported models:

• 33 keypoints in total
• the first 16 keypoints are the COCO set
• the remaining 17 keypoints are those unique to BlazePose, in order from head to toe
• regardless of which model you use, all 33 keypoints will be provided; keypoints that aren't supported by the model, or which don't meet the specified minimum score, will be set to NaN

Keypoints

0: nose
1: left_eye
2: right_eye
3: left_ear
4: right_ear
5: left_shoulder
6: right_shoulder
7: left_elbow
8: right_elbow
9: left_wrist
10: right_wrist
11: left_hip
12: right_hip
13: left_knee
14: right_knee
15: left_ankle
16: right_ankle
17: left_eye_inner
18: left_eye_outer
19: right_eye_inner
20: right_eye_outer
21: mouth_left
22: mouth_right
23: left_pinky
24: right_pinky
25: left_index
26: right_index
27: left_thumb
28: right_thumb
29: left_heel
30: right_heel
31: left_foot_index
32: right_foot_index

@citizenjoe Apologies, my IT department hasn't been able to help me yet, and I wasn't comfortable downloading the shutter encoder to my personal laptop. Is HAP the only codec that works if I do need interactivity? That's a large reason why I use Isadora. I'll admit I'm not sure how to download and install something from github, it's always been a bit of a mystery to me. I think AfterEffects removed to option to export HAP.

I'm really glad to hear your machine works well and there's hope! So, just to confirm, your issue is purely because of the codec and needing HAP? Nothing to do with integrated GPU vs NVIDIA? Or external displays?

Thank you!

I am interested in getting a gspat into Isadoera and wondering if it is possible. I am looking at using user hand position to control the view of the splat eg simple rotation and maybe zooming in to the splat model. 

Is anyone looking at this format? here's a link of some examples, not my models but hey so it goes https://gsplat.tech/ and one test one https://scanvast.co.uk/menu6/

I just found a tool I think you'll love that was given me by the author. Colin Clark, an incredible person, a composer and software developer (and much more !) based in Toronto. He created a software called Movement OSC, (mac PC and linux) that does pose estimation and sends osc. It can also compare Movenet and MediaPipe so you can compare them ! The software formats the osc messages 4 ways Bundeled messages per axis, messages per axis, and bundled xyz array. I use just the latter then parse it in the Json parser 

Here are the keypoints and the keypoints diagram 

Enjoy !

0: nose
1: left_eye
2: right_eye
3: left_ear
4: right_ear
5: left_shoulder
6: right_shoulder
7: left_elbow
8: right_elbow
9: left_wrist
10: right_wrist
11: left_hip
12: right_hip
13: left_knee
14: right_knee
15: left_ankle
16: right_ankle
17: left_eye_inner
18: left_eye_outer
19: right_eye_inner
20: right_eye_outer
21: mouth_left
22: mouth_right
23: left_pinky
24: right_pinky
25: left_index
26: right_index
27: left_thumb
28: right_thumb
29: left_heel
30: right_heel
31: left_foot_index
32: right_foot_index

Keypoints diagram

Anyone having success using a motion/depth sensor camera for a gallery installation that is native to or at least works very well with MacOS? I would prefer to use Isadora over TouchDesigner, but every camera I look into seems to run into issues with compatibility. Looking into Orbbec Astra 2 or Mini now but would be very grateful for recommendations (and success stories)! I am an artist and am new to this motion/depth sensor tech but highly motivated to figure it out. Currently on an Intel Mac but may upgrade to Silicon sooner rather than later if that makes a difference.

Thanks in advance!

@trevor said:

a step on the cue sheet

 Are you using 'Cue Sheets' or are you referring to 'scenes' as cues?

If you are talking about Scenes, you can add a 'Jump' actor with a relative setting of -1, connected to a keyboard watcher. This will move you back 1 scene.
Or, open the 'Edit Go Triggers' dialog from the 'Scenes' menu, and assign a Go Trigger (keyboard, MIDI, or HID) to the 'Previous Scene' direction. This will apply to the entire show, while the Jump actor needs to be added to each scene.

If you are using the 'Cue Sheets' feature, you are able to send keyboard commands to the scene as define in the Cue Sheet Editor. These allow for what you can think of a sub-cues within a Scene. Now if a Cue is triggered, it could do all sorts of things, including starting timed operation, looped operations or interactive controls. It isn't practical to be able to step backward in the cue sheet since there is no clear definition as to what 'rewinding' would be. You can however, build some form of step back into your patch, that resets things to certain configurations, however this is very much a custom approach.
If you are unfamiliar with Cue Sheets, you can watch an introduction here: Working With the Cue List Editor and Cue Sheets

How do you step back a cue. In other words, if you inadvertently trigger a step on the cue sheet, how do you step back one cue at a time.

For example:

There are five cues in a scene, triggering various functions

I accidently trigger Q3, how can I get back to Q2 without opening the cue sheet?

Of course, I can easily step back to the previous scene, but not a previous cue.

Thanks for your help.

@lwebster said:

@citizenjoe That is so strange! I wonder why that happens with some Dell models? Unfortunately I don't have permission to download programs without IT (they're very strict) so I can't re-encode it to HAP with Shutter Encoder (at least not right now) - could I try a different codec that I could export from AfterEffects, or do you have an alternative re-encoder I could try?

 You may not be able to do this without IT, but you can install the HAP codec for Adobe Creative Suite and do it direct. For the sake of trying it, could you convert the media files on a different computer? 

You can try H264 if you're not working interactively with the files. Look at tips 5, 6 and 7 here: Hot Tips to get the Best Performance from Isadora : TroikaTronix for further ideas.

Also here: Create Windows Native HAP avi Video Files : TroikaTronix

For the record, my machine works REALLY well with Isadora and I do have the A4000 GPU running independently of the integrated graphics!

Cheers,

Hugh

@citizenjoe That is so strange! I wonder why that happens with some Dell models? Unfortunately I don't have permission to download programs without IT (they're very strict) so I can't re-encode it to HAP with Shutter Encoder (at least not right now) - could I try a different codec that I could export from AfterEffects, or do you have an alternative re-encoder I could try?