IR Camera/Hardware Question

[atrawickb]

Thanks for the input Feinsinn,

What camera(s) are you working with?  

All best,

[atrawickb]

@Fred

I got the CCTV camera and Blackmagic Ultrastudio Mini Recorder as you recommended.  Links to hardware here:

http://www.ebay.com.au/itm/HD-SDI-1080P-Full-HD-Box-Camera-2-Megapixel-1-3-CMOS-Image-sensor-CCTV-Security-/281010620283?ssPageName=ADME:X:AAQ:AU:1123

https://www.blackmagicdesign.com/products/ultrastudiothunderbolt

As you can see from the attached image files, the camera feed is coming up in the Blackmagic Media Express Player, but when I go to pull the feed into Isadora, the frame rate and pixel matrix combination that the camera is capturing in (1080p 30f/s) does not come up as an option, which is a bit strange as the system preferences in the Blackmagic Media Express player is set to that, AND Isadora is (as you can see) recognizing that a Blackmagic device is connected and prepared to transmit a signal.  

I don't understand what to try next, and neither did the Blackmagic support staff who I was just on the phone with for almost an hour trying to troubleshoot this.  Please advise.  

My next question will be, what will I have to do to get the camera to only see infrared light?!  

I was under the impression that that's how it would record straight out of the box.  As it is, it's capturing feedback loops from my projector which is EXACTLY what I'm trying to work around through this process. 

Thanks in advance for your time and attention.  All best,

[Fred]

Isadora uses an outdated capture system so it does not see the 1080p 30 setting. Using black syphon you will get the image into Isadora or by switching the camera to 720p will let you get the image into Isadora directly- there are many posts about this on the forum, it is an Isadora problem- later capture modules such as AV foundation or the native grabber on Windows have no trouble with this.

Yes the camera will see IR light, as it is it has an IR blocking filter in it, you can turn this off by going through the menu and finding the colour/B&W or night mode (the menu in the camera).

This will remove the IR blocking filter (you will here the solenoid pull the filter away from the sensor). However if you want IR only you need an IR bandpass filter (I have posted about this a few times on the forum, as with the other issues you are having).

You can either buy a high quality IR pass filter from mid west optics (or a distributor) or you can go for a DIY solution. 

Google DIY IR pass filter and you will see a lot of potions, basically using exposed film or the inside of a floppy disk. Depending on you situation you can get away with it.

IR is good for tracking- I am not sure what you are doing, some video projectos will emit IR light. The other way you can stop the camera seeing images from the projector is to use opposing polarising filters, one on the camera the other on the projector- IR is great for providing high contrast images from tracking without changing the light if your set, but I am not sure what you are trying to achieve.

Let me know what you are trying to achieve, much of the work in IR tracking is setting up the lighting, making sure you have no other IR emitting sources (other lights especially halogen but most incandescents also emit IR- you can use IR blocking filters on these lights). For tracking you are trying to get as much contrast between the background and the subject as possible, this can be either front or back lighting. The next job is to set up the tracker to ignore any artefacts you don't want (blobs that are too small or too big).

You will have to go through all the camera settings and turn off all the auto adjust settings- there are quite a few, then play with the shutter and gamma to get a good high contrast image- sometimes, only sometimes using a slightly out of focus setting will help. These lenses are default f 1.2, so focus with depth is difficult, you are better to set the aperture closed a little and add more light (change the gamma to avoid hot spots) to get focus near and far from the camera.

If you are using shadows, you will need to create the shadows with IR light- most of the details are already in this thread- have another look and take the time with lighting.

Fred

[mark]

Dear @Fred,

I am going to start working to address these Blackmagic problems for Isadora 2.0\. But the question I cannot seem to answer through my initial searches is this: does AVFoudnation actually allow you to adjust the various input settings? I see nothing in the API that supports this, but I am very happy to be proven wrong. Or is the only solution to directly access Blackmagic's proprietary API? 

I've also written Blackmagic seeking answers to these questions, but I figured you might have a quick answer for me.

If you know of any open source software that supports the needed features, all the better, as I can see how they approached the problem.

Thanks in advance for the tips,

Mark

[Fred]

I think gstreamer will do it, otherwise what settings exactly do you want?

Here is the avfoundation example

82db51-avrecorder.zip

[Fred]

Sorry, that is the avfoundation example, as for the Blackmagic API, what settings exactly would you want to change, it lets you select between any of the formats that the hardware is capable of- then you can get pixels-> textures from the input. Is there a need to go outside of the input settings? if you have this hardware and it works on your machine it is fine to get the actual format in right? It is faster than the quicktime capture and lets you change inputs (physical) and formats on the fly after initialisation.

Fred

[Fred]

@Mark Sorry, I thought you meant avfoundation, the blackmagic API lets you change formats (within the limitation of the standards that the capture card accepts) and even hardware inputs on the fly once the object is created. Is there a need to change formats- I take it you are referring to a codec? Is there a necessity to change codecs- if you get pixels they are always uncompressed right- and the upload to a texture is fast and then it is a texture.

Here is my fork of an OF addon to interface with blackmagic hardware. It is basic - I did not add all the functions, but it supports multiple devices- the formats are set to the available capture formats (in a lazy way, I put all possibilities, some are not available in some devices).

https://github.com/fred-dev/ofxBlackmagic

Avfoundation also supports the hardware and so does native windows capturing. Let me know if there is anything I can help you with, I am not sure I understood your question.

Fred

[atrawickb]

@Fred

The situation that I am trying to figure out is as follows:

I have constructed a large mobile sculpture (approx. 52 foot max. wingspan) which is anchored in an I-beam that carries the roof/ceiling for the building.  The mobile has a large white wall surface area at a certain distance behind it on which interesting shadows are easily generated by casting hard light on the mobile as it moves.  

Therefore the idea is to cast halogen (containing IR light) on it from one angle to generate shadows, which from another angle we will seek to capture those shadows live with a video camera that captures only IR light.  That video camera should then be lined up with a projector such that it is capturing the same field that the projector is throwing into.  At that point, employing the 'Add Alpha Channel Actor' in Isadora should make it relatively easy to capture the shadows clearly and proportionately with the camera and project directly into them (and only into the shadows) whatever footage we want.  

It is the hardware end of this situation that is proving difficult.  

1\.  As you noted, Isadora does not currently support bringing in a Blackmagic signal that is 1080p at 30 fps. 

2\.  While the camera you suggested does capture in 1080p, which matches the projector's resolution, said camera captures in such a wide-angle format that it is impossible to match the much more telescopic throw of the projector.  

3\.  I currently don't have (but now thanks to you know where to find) the right filter for the camera and in-camera menu adjustments to make.  

4\.  Are there any out-of-the box video cameras that are well-suited for IR tracking?  Teaching at a university, I have quick access to a number of models.  While I do have time to track down an external lens filter or something along those lines, a full-blown internal hardware hack is not possible with cameras that aren't mine (owned by the university).  

Thanks again for all of your help thus far and in advance for any and all further advice.  

  --TB

[mark]

Dear @Fred and other Video Capture Experts,

I've started a discussion thread about Video Capture for Isadora 2.0

http://troikatronix.com/troikatronixforum/discussion/1609/isadora-2-0-video-capture-expertise-and-opinions-needed

If you have expertise or opinions to offer, please chime in there.

Thanks,

Mark

[Fred]

Projector camera calibration is a tough task, getting camera and projector intrinsics and extrinsics requires a full implementation of open CV and a calibration routine.

To answer some of your questions, no DSLR is ready for IR, then need hardware modification. They are also notoriously bad at live capture and the lenses wont match- no matter what you think you see, you need to run a calibration grid to see where they are off, it is not just getting the same outer rectangle.

What you want to do is possible but I suggest doing your research, many of your questions were even answered in the above thread, take the time to read this and other threads in the forum.

For projector camera calibration you could start here- it is what you need to do to achieve the results you want. No lenses just match.

Here is some code and a link to a tutorial for what you want to do with the calibration

https://github.com/elliotwoods/artandcode.Camera-and-projector-calibration

As yet this is outside the possibilities of Isadora, but you could make some tools that are syphon enabled to let you use Isadora in this process.

Fred