Kinect and projector calibration

Ilir Gruda

Hi there,

I am trying to calibrate the kinect and projector in order of projecting visuals on a dancer. I am not being able to put all the visuals into the dancer, so is there a mathematical way that could help me to achieve this. For example the what distance should my projector have if he has a specific lens. My projector is Sony VPL- DW120.

Best,

Ilir

primaldivine

Hi Ilir
Well, congrats on making this sound simple ;) LOL

Actually it is very difficult to correct for the differences between the camera lens/position and projector lens/position. Its the million dollar question actually in projection mappping onto a moving body. Google 'Klaus Obermeier' on Youtube to see some examples of it being done very successfully.

Have a read of the attached document, for one way to solve this using IR camera, mirrored glass and IR lights. But you will still have to play around to get the camera lens and projector lens to match. Its a matter of trial and error... and determination.

primald
5d3fe9-ir-camera-tracking-tips.pdf.zip

crystalhorizon

When you watch the Klaus Obermeier stuff, then have a look if the performers are restricted to tempo: it looks like some of the mapping effects are not possible with high speed movements

Maximortal

There is an italian developer that show me a software made by some Duch guys that do exactly what u need, but unfortunately I can not link the demo video 'couse he don't want untill he is ready at all.

The concept at base is a mesh projection. What I suggest you is to place a plane with some pattern at end of space you need to have an then take a picture of it with kinect camera,feed projector with this picture then manually (and with a lot of patience) adjust an 3D quad distor projector (or use brand new mapping utility in isadora 2.0) actor to overlap exactly the starting pattern.

eight

https://vimeo.com/75415111

Fred

Quad distort and Isadoras other tools are not enough to do this. To match any camera and proctor properly you can use openCVs calibration tools to generate a set of distortion matrixes. OpenCV then has the function warp into me that will apply this matrix to images. This is not that new, it has been going on for quite a while, and while well out of the scope of Isadora it is quite doable.

There was a workshop from Elliot woods that covered this

https://github.com/elliotwoods/artandcode.Camera-and-projector-calibration

Here are some other version- open source and with instructions.

https://www.youtube.com/watch?v=pCq7u2TvlxU

http://www.kimchiandchips.com/blog/?p=725

http://www.camara-lucida.com.ar/tutorials/calibration

https://github.com/chparsons/ofxCamaraLucida

All these variations (and there are many more) will do exactly what you want, no need to wait for anything and no need for trail and error, the chessboard you see is of a known size and a preset tool for calibration with openCV. The above resources will show you how to do this programmatically and get great results all the time. However, to achieve this you will need more advanced tools than Isadora as it has no implementation of openCV.