Photo booth like removing background
-
and maybe you can help me also to find the Kinecttoizzy QC plugin, I search and search and can't find it to download… new or old forum… sorry again
-
EDIT: don't use this method.. its an unfortunate early attempt ;)
I have added something just like this to my livefeed option in SYST3M, unfortunatly the next version its far from ready to share (not working perfect yet).
I think what you want to do is (at least what i did) is use a buffer actor to stream into your difference actor.
Your buffer needs to be 2 frames and being filled with the freeze frame and your live feed, alternating at the same rate as your FPS (I used the 'Performance Monitor' to set the rate of a Pulse actor->counter->selector. there might be easier ways).
Since the difference actor looks at 2 frames (in sequence) of 1 video stream.
This will give you a black and white video stream of the 'change', which should be you.
You can then use this stream to add an alpha or mask your stream onto another background.I'm attaching a screen grab of a sample.
You can see that I stopped using the pulse as the trigger, since the live feedfeed seemed not to be the same FPS as my stage.
In anycase this is kind of working.. but I have a fast video flicker.. this might be an issue with my buffer setup.. not sure.
Its a start.
-
try my sample patch
-
Heres one that is working pretty well for me.
-
note: like Skulpture mentioned before, you need to grab a freeze frame that is of the static background first..
then you may need to play with the threshold and other actor settings to tune it up. -
and it does help to switch the camera from automatic to manual settings.
-
I like @DusX solution using the AlphaMask!
* I might have to recreate that patch and steal it for my collection ;) * -
if lighting changes you will also need to grab a fresh background frame - depending on your situation it may make sense to grab a fresh background frame whenever the total movement in the frame is less than a threshold - this will help protect against slowly changing light levels
-
@nick I was thinking of adding a motion detection based reset as well, good call, since half the work is already done.
@Skulpture go to it.. would love to see what you are able to add to it.
@Michel you are so right I was just playing with this with a cheap webcam that is all auto focus, auto white balance etc.. and it simply didn't work at all anymore. -
yep - movement or light changing are our descriptions of how a difference has been generated, as far as isadora is concerned they are both just differences in pixels across the frame
-
Hi everybody, thanks so much for your help, I'd like to invinte you all to drink a pastis in the sun but I can't upload the bottle…
A question remains to me is the blinking effect, how do you get rid of that ? I tried a pulse generator, but I still get my selector slowly switching from 1 to 2 with unregular rhythm, my computer is also slowing down to 10fps… -
Yes the flicker is quite annoying; but I guess since you are wanting to take a picture this shouldn't effect things too much.
I am working on this though. By Ssing @DusX glrious technique (with a bit of tinkering) I think it can be done quite effectively. But I need a bit more time. -
Hi Skulpture,
thanks for your reply. In fact, I don't need just a picture, I need to have this as a live stream overalyed on a video file… -
Apologies my mistake. So the jutter/jitter is quite important then! :-)
-
I was able to get a rather smooth video with my last patch uploaded.
By dropping the buffer element and triggering direct from the live input the flicker was removed.
The only artifact is that the mask is recreated on every other frame so I added the motion blur to help smooth this out. I was pretty happy with the outcome, however; I don't know exacly what you are planning.
You could alternately use the mask stream to inject an alpha channel to the live video allowing some other compositing.
Frame-rate is really going to depend on your live streams source resolution. I can get 30fps at 640x480, but my machine is current and fast. The blur effects are going to be a factor here as well, so I think I had 2 gaussian blur actors, you can do with out, or use just one. I was playing with removing some background details since in my living room here I have a large window behind that was causing some problems. If you can light yourself and keep the background dark you should have a much better time of it. -
I was using motion blur and effects mixer using submin mode instead of the selector but it was still jumpy. (will post patch soon)
I also had issues with submin as in certain spots it spoiled the effects; so really, like you say DusX, the key is background and light control. -
Hi Skulpture, did you had a brilliant idea about that project of removing the background without jumpy image? I tried without finding a solution. I thought it would be easier, photo booth did that so simply, it's using the same parameters we can have in izzy, but how ?
thanks -
I will try and finish it today. I was nearly there but still a little jumpy.
-
This is the closet I can get.... its not perfect by any means!
My background at work is awful; full of multicoloured posters so that doesn't help me. -
I think the idea is sound.. just trying to process the selection is the hard part since you don't get a clean outline from the difference actor.
Some sort of 'vectorize' effect like photoshops cutout might help.. I may play around some more....I have MANY freeframe FX.
Maybe a burn and dilate combo.. ?
