Any news on this issue from your side?
There’s more audio capabilities coming with the next release. You’re already in the beta program so you should have access to the new beta and new audio actors. Have you tried working with any of those?
In particular, the new Audio Frequency Bands, Audio Frequency Watcher, and Audio Level Watcher let you do live audio frequency and level analysis without needing to go through the Live Capture system (and thus lets you use as many virtual audio sources and/or mics as you want).
P.S. Anyone else reading this who’s interested in trying out the beta with the new audio actors (which also adds VST3 audio plugin support, a Audio to Text actor, and more) can send in a ticket using the link in my signature below.
You can probably also use a normal camera with the Freeze + Difference method in this tutorial: https://troikatronix.com/add-ons/tutorial-basic-motion-tracking/
And which is explained here: https://vjskulpture.wordpress.com/2009/12/14/motion-tracking-in-isadora
But you’ll likely need to use other video actors like Contrast Adjust to make the dancer pure white.
It’s also very lighting dependent, but it works from further away than a Kinect.
Really there are a number of ways to do this. In the end it comes down to what your input material looks like?
How close are the dancers to background objects? Is the background a solid color or something else? How much control do you have over the lighting?
Current tools like MediaPipe, can be used via Pythoner to use AI to create this masking, and will work with an RGB camera, but will be limited in framerate and resolution by the machine processing the feed. While others options can use different keying methods to mask the dance/background separately. The example given was likely shot on a greenscreen at the time, and had the foreground chromakeyed from the background. Luma key can also be used to separate light and dark, but this will make separation of things like feet on the ground very difficult.
If you are running on PC, and have access to a Kinect V2, my kinect2share software can provide the silhoette as well.
Hello.
Is there a simple way of creating a silhouette of a dancer like what we used to see in the iconic iPod commercials? https://www.youtube.com/watch?v=IJTpLtw7vn0&t=5s
I tried a couple of ways as you can see in the attached patch, but I'm certain that some of you know the better ways to do it.
Thank you for your help!
Is anyone using VCV with OSC and Isadora. I hit a wall with the complexity of my patching projects for audio reactive work and am taking a step back to reassess my approach. I revisited VCV as a possible way to quickly itterate various audio processing methods (audio in from members of the group) and expose some fun controls for audio reactive visuals without having to build things myself. I'm in the process of trying to do up a custom module that will take an audio input, do an fft and split it into bands (4, 8, 16, 32, 64), RMS and a few other things and send it out as osc. This along with the built in CV to OSC in VCV modules seems like it might be a good way to easily itterate not only audio analysis but other controller functions - eg sequencing, triggers with fall off, various wave modulations etc. This + it saves - and will even fade between - complex patch states.
I would be curious to know if anyone else is using VCV or actual hardware racks with Isadora. How are you using the combination?
@dusx
Hi Ryan, I've not used Get Media Index, I think the combination of those 2 and a bit of maths might do what I need.... thanks
@dbini
Is there something you can't easily do with 'Get Media Count' and 'Get Media Index'?
Generally using these two, and a counter I am able to easily run through animations etc when contained in Media Bins.
Do you think it might be possible at some point in the future to be able to have a Media Bin input to Picture Players (etc)? The option to have different bins in the Media library is nice, but do they have a particular use in the scene? I'm currently building a show with a bunch of different animations, each made up of a sequence of pictures in different bins, but the Picture Player only sees their index number within the entire library. It would sure make this project easier if i could set different Players to different bins.
Any ideas?
: )