Phone Sensor Data

[Eager Iguana]

I just came across http://zig-project.com/ Iphone and Android sensor data to PC with a monitoring program. Much to play with here. 

Regards

[bonemap]

@eager-iguana

Hi,

The Zig Sim Pro has some interesting features - particularly the integration with Apple iPhone ARkit features. I was looking at the 74 face tracking points available through OSC and how they might be used in Isadora. 

Best Wishes

Russell

[Armando]

@bonemap Thanks for this interesting app. It does the facial motion capture and sends it over osc?

[bonemap]

@armando,

Zig Sim Pro does send iPhone face tracking data over OSC. It appears to use Apple ARkit face tracking 'blendShapes' as tracking points.

https://1-10.github.io/zigsim/...

Here is a list of the tracking points in Isadora Stream Control window:

[n.jones]

@bonemap great little app , but looks like since I've updated to Big Sur on my test Mac the NDi function doesn't send an image anymore .. swing and roundabouts ;)

[bonemap]

@n-jones,

You are well ahead of me. I haven't tried NDI streaming from Zig Sim Pro yet .

Best wishes

Russell

[Woland]

@n-jones said:

I've updated to Big Sur on my test Mac the NDi function doesn't send an image anymore

 One of the many reasons I never touch the most recent macOS. I always stay at least one behind to give Apple and 3rd-party developers a year or so to work out all the kinks.

[bonemap]

@n-jones said:

swing and roundabouts

I took your advice and tested the NDI stream on a MacBook Pro 10.15.7.
I still had some issues keeping the stream going but very excited to see a depth camera image going into Isadora wirelessly from my iPhone....

[edit] The NDI stream also worked in Mac OS 11.2.3 Big Sur on a MacBook Pro with NDI Virtual Input and Isadora NDI Watcher

Best Wishes

Russell

[n.jones]

@bonemap I know cool ,right! My next one is to test out the main Lidar camera on the iPad Pro . Hopefully I should get a much deeper range .I'll let you know after I've scrounged one from some where.

[FTP]

@n-jones

How did it work out with the Lidar camera?