KinectV2 OSX

Fred

I had a few minutes to put this together, it is a utility to use kinectV2 on OSX via syphon. It is very basic as kinectV2 on OSX is super limited, but it seems to work Ok. Maybe someone has a use for this.

You can get the binaries here (10.9+)

https://github.com/fred-dev/KinectV2_Syphon/releases/tag/0.0.1

Fred

Skulpture

@Fred - you are amazing!

I can't test this because I don't have a K.V2 but I love it already! haha

chimerik

Oh my god! I got K.V2 a while ago and couldn't find anything that works on Mac OS X, so I'm so stoked to see this post! I'm traveling now but will be able to test it next month and will keep you guys posted. How exciting! Thank you for sharing @Fred.

bennid

Hi there,
a few month after i'm wondering about skeleton abilities on mac osX,
because this new Kinect One V2 seems to be really interesting on finger tracking and muscles tensions input, and light changes improvement,
are there any news regarding a hack to get osc datas?

BTW, do you now if we must use an adaptator, i've heard it's not a usb port anymore...
Thanks a lot !

Michel

keep an eye on this: https://www.indiegogo.com/projects/orbbec-persee-world-s-first-3d-camera-computer?mc_cid=9a3392cad7&mc_eid=75f8821992#/

Best Michel

chimerik

Hi @Fred,

As I promised to, I finally got time to test the Kinect V2 with this "KinectV2_Syphon" application, but so far it only shows a black window with 60 FPS and OpenCL Device: 0\. I've tried restarting my MBP, but still the same result. Is there anything else I need to install before using this application?

Thank you,
Sammy

Fred

I sometimes had my kinect not respond during using and making this. The way I made it work was to connect it to a windows machine and run the viewer from the kinect SDK, this then fixed the connection handshake and I could use the device on OSX. I thought this was just the kinect I was using as it was a bit battered but it seems it is not unique. I am looking into a fix for this at the moment but in the meantime try using windows to sort it out.

Fred

chimerik

Hi @Fred,

Sorry that I didn't see your reply until just yesterday. Mark and I just tried the Kinect V2 on a Mac booted in Windows and it works on Windows, but the KinectV2_Syphon still doesn't work on my Mac under OS X. Not sure if there are any other way you know of? Or anything else that we needed to do?

Thanks!

Fred

What version of OSX, I have not checked this for a while as I only had the kinect 2 for a while. I'll have a chance to check out soon.

mark

Dear All,

I've been working here with @chimerik and I think I have a tip for @Fred 's app. This tip came from various reports from the libfreenect2 community, the library used to enable connectivity with the Kinect v2 on Mac OS.

Ensure power is applied to Kinect v2 via power supply
Plug in USB 3 connection to computer
Attempt to run Fred's app... likely it won't work. Quit the app.
Unplug power to Kinect v2 but do not unplug the USB 3 cable
Restore power to Kinect.
Run Fred's app. Voila! It works. (And seemed to work every time thereafter... though we never rebooted the computer nor did we reconnect the Kinect v2.)

Worked for us. ;-)

Best Wishes,

Mark

P.S. Also ran this super simple app on a PC to get Skeleton data from the Kinect v2\. We then sent the OSC data to the Mac with @chimerik's patch. Very reliable and as simple as can be. https://github.com/microcosm/KinectV2-OSC

P.P.S. Because the Windows app above changes the ID for the body every time a new body appears, added a new feature to the Stream Setup. You can now code an address like this /first/*/third. The * means "match anything" so that, even if the second part of the address changes, the message will still be recognized. This will be available in the next beta.

mark

@Fred

Hey one other thing, from an OF newbie. I tried to compile your app, but am getting millions of errors due to freeimage.a

E.g.,

Undefined symbols for architecture i386:

"_uncompress", referenced from:

Imf_2_2::DwaCompressor::uncompress(char const*, int, Imath_2_2::Box >, char const*&) in freeimage.a(ImfDwaCompressor.o-i386)

Imf_2_2::Pxr24Compressor::uncompress(char const*, int, Imath_2_2::Box >, char const*&) in freeimage.a(ImfPxr24Compressor.o-i386)

Imf_2_2::Zip::uncompress(char const*, int, char*) in freeimage.a(ImfZip.o-i386)

(maybe you meant: _ssl3_do_uncompress)

"_opj_stream_set_user_data", referenced from:

opj_freeimage_stream_create(FreeImageIO*, void*, int) in freeimage.a(J2KHelper.o-i386)

"_opj_stream_set_user_data_length", referenced from:

opj_freeimage_stream_create(FreeImageIO*, void*, int) in freeimage.a(J2KHelper.o-i386)

"_opj_stream_set_skip_function", referenced from:

opj_freeimage_stream_create(FreeImageIO*, void*, int) in freeimage.a(J2KHelper.o-i386)

Any idea why that's happening?

I installed freeimage using homebrew, but to no avail. If you know of a simple solution, that would be great.

Best Wishes,

Mark

Fred

Ok, I updated the giutub to the latest OF and up to date versions of all the various libraries and addons, there are some changes in the dependancies for the addons that are used.

It should fix some troubles getting the kinect recognised and a few things are cleaned up.

Mark- I am not sure exactly what you are doing with OF, if you download the latest release and then collect the addons needed (check the git for this app and the links for the various addons) and clone them to openframeworks->addons it should work.

Clone this repo into openframeworks->apps->myApps

I did it with the latest branches this morning and had no trouble.

DusX

@mark

The * fix is great. That new body address was really driving me nuts.

Fred

Just did some more fixes (finally got hold of a kinect v2), github is not playing nice with the crappy internet here, the repo is up to date, but not the release, ill upload it later tonight with better internet.

crystalhorizon

Can't wait to try this with my Kinect 2. Great thread here

Fred

Just a note that the release is updated, I have a bit of time and access to a kinect, it would be great if someone ha the time to try it out.

Aolis

Just got a hold of a Kinect v2 and followed Mark's steps listed above. Was up and running in less than a two minutes!

Thank you so much Fred!!!!!!

-Alex

Aolis

Just a question,

Is the white line that I am seeing in the RGB feed a standard artifact from the Kinect 2?

b73679-screen-shot-2016-08-17-at-8.51.28-pm.png

Fred

Not for me so far, but I have to say my testing is super limited. I don't have a kinect V2, they have come and gone for a few projects for me. I tested this with 2 laptops and one kinect and I did not see this... The driver for OSX is an experimental 'hack' so it is also not perfect.

peppironi89

Hey Guys,

Just a question for the long term.

I'm really looking forward working with my new Kinect V2. I got it working on a Windows machine but still a hassle to get it to work with Mac. All these links here look really promising.

Although I have a more specifiek question. Does anyone know if there is an app or code to get the heart rate data over OSC ? and maybe some other data then the Syphon stream? Saw the kinect giving me data like state of being, wearing glasses or not, married or not and so forth.

Here in the Netherlands every gamer tries to get rid of its Kinect V2 and they go for 50,- euro's nowadays :p but since i'm not a good coder I depend on github and smart people to get it working in my favor...

Cheers!

Pépé