Audio Features for Isadora: What Do You Want?

bonemap

Happy?

Elated!

So what you are saying is that a ‘new’ feature output that provided current channel mapping and volume is possible for the Sound Player? And/or the input might be modified to allow reconfiguring/saving the string directly, bypassing the UI pop out.

A string output could then be used to match and modify audio matrix settings of other Sound Players/Movie Players in subsequent scenes. Or saved and transferred to other patch files.

That would be very useful, I think.

Best wishes

Russell

Woland

@bonemap said:

So what you are saying is that a ‘new’ feature output that provided current channel mapping and volume is possible for the Sound Player? And/or the input might be modified to allow reconfiguring/saving the string directly, bypassing the UI pop out.

It also means that you can interactively change the routing between presets ;)

Fred

@woland @mark random question. what happens if there are movie players with different routings in scenes that crossfade? I'm guessing you solved this already, will it fade in and out on all channels?

mark

@fred said:

andom question. what happens if there are movie players with different routings in scenes that crossfade? I'm guessing you solved this already, will it fade in and out on all channels?

Well, the first movie would fade out and the second would fade up.

Let's say you have a stereo movie in both scenes. In Scene 1, the two channels are routed to outputs 7 and 8. In Scene 2, the two channels are routed to 6 and 7. As the volume of Scene 1 goes down during the cross fade, the first movie's audio on 7 and 8 fades out. Simultaneously, as the volume of Scene 2 goes up during the cross fade, the second movie's audio on 6 and 7 fades in.

Best Wishes,
Mark

mark

@bonemap said:

So what you are saying is that a ‘new’ feature output that provided current channel mapping and volume is possible for the Sound Player?

Not sure what you're saying here... "feature output" ??? The new 'routing' input is an input, not an output. I don't think I said anything about outputs.

But I'll just go over it again: the routing input for the Sound Player (working now) and the Movie Player (will come during phase II of this project) is a text string. You can feed that text from anywhere you'd can provide text: a Trigger Text actor, a Text Formatter actor, a Get Global Values actor, etc.

That said, I can see a new actor that implements the routing UI element when you click it, and provide the routing string as an output. Maybe that's what you mean?

Best Wishes,
Mark

Fred

@mark yes, as expected, I don't know why I would have thought otherwise

Juriaan

@mark

What we are proposing is that we get the routing that is inside the Sound Player (Movie player in phase 2) as an output of the Sound Player that contains a string value with the routing. So just like the input string that we provide we would love to get the same on the output side of the actor

That way we can use that string again to make some powerfull user actors (like a preset system)

Woland

@juriaan said:

What we are proposing is that we get the routing that is inside the Sound Player (Movie player in phase 2) as an output of the Sound Player that contains a string value with the routing. So just like the input string that we provide we would love to get the same on the output side of the actorThat way we can use that string again to make some powerfull user actors (like a preset system)

Ooo I like this. That sounds tasty!

bonemap

@mark said:

That said, I can see a new actor that implements the routing UI element when you click it, and provide the routing string as an output. Maybe that's what you mean?

Hi @mark,

Yes! That’s right an output string from the audio matrix UI. You are the consummate programmer so I know from participating and listening to many discussions like this over the years that you will see the most efficient, flexible and appropriate way to implement something in Isadora. And your vision for a new actor that outputs the matrix string appears to be the sensible way to resolve the potential of working with the audio settings over multiple scenes/ patches etc.

Best wishes

Russell

mark

@juriaan said:

So just like the input string that we provide we would love to get the same on the output side of the actor

In other words, you simply want a "through" -- whatever string comes into the 'routing' input goes to the 'routing' output, including the string generated by the UI element.

Wouldn't it be better to simply have a "Matrix Routing" actor that provides the routing output, i.e., the actor itself is the same UI element as seen above. So you could click on the actor to edit and you get a string output? (Of course the downside of that is that it won't automatically know the number of channels in the source audio file like the Sound Player does.)

Best Wishes,
Mark

mark

VU Meter UI Test. ;-)

deflost

@mark

hello. great.

do you think something like the surround panner( max for live device in ableton live 10) is possible. a grafik interface to midi or osc configer the volume level of a sound on a maybe 8 speaker setup in a room?

thx.

r.h.

Juriaan

@deflost

Sorry I dont understand what you are saying ? You can use OSC and MIDI to change the volume of your Sound players by using the OSC Listeners / MIDI listeners and tie them directly to the Sound Player in question. Or is what you are saying that you wish to map UI elements directly to OSC input / MIDI input like Resolume / etc ?

msanii

@Juriaan I think @deflost is referring to this in part https://www.ableton.com/en/pac...

jfg

it looks great but I though more about to have it in the control panel. During the work on the canvas I can always use the AUmixer or AUMatrixMixer to control the sound level. But if I use during the show a only control Panel interface I will need something to see the sound level.

thanks.

best

Jean-François

Fred

@deflost with the input string containing all the levels for each channel this is pretty easy for us to make with a little JavaScript. Now that the raw functionality is there we can make any kind of planners.

Having user the Ableton "surround planner" it is really pretty bad and leaves out most of the calculations to actually do surround. There is a project called envelop that has a much better planner and is open source. This could be a good start for a flexible roll your own surround panner. As all we actually need to do is change some values in a string it is pretty cool. The advantage of us making this as user actors is we get precise control over important things like speaker numbers and offsets (missing in the Ableton implementation).

deflost

hello.

maybe you are a programmer. we Not!

we have to buy software to work with.

and we allways hope it works.

so, the ableton (max for live)

surround panner is better

then a " maybe it could work with 7

workarounds and a couple of years of

additional study of programming, and on windows not

at the moment".

mark

@deflost said:

do you think something like the surround panner is possible. a grafik interface

I think a simple implementation of this is possible actually. I was already thinking of it today as I continued to work on the audio, thinking that I could add a new input called "pan mode", where one of the options would be 'circular' so that as you panned from 0 to 100, it would go from speaker to speaker. I guess we'd need another input called "pan width" as well because maybe you want the sound to "bleed over" to the adjancent speakers when the pan position is centered on that speaker.

However, as @Fred and @Juriaan will probably tell you, this simple implementation is not at all accurate. To be fully accurate you'd need (at least) to provide Isadora with the measurements of the position of the speakers in space. I'm not at all an expert on spatial sound... there's probably a whole lot more to it than that and probably they can say more about it. (Please start an "Off Topic" thread if you wish to get into detail about that topic, OK?)

But in terms of something basic, so that you can have -- for example -- four speakers in a room and know that a pan value of 0% is only speaker 1, a pan value of 25% is only speaker 2, and so on, is certainly quite doable.

Best WIshes,
Mark

deflost

hello.

thank you very much for thinking about.

j.w., r.h.

mark

Dear @Fred, @Juriaan, @RIL, @bonemap @ian @jfg @kirschkematthias @tomthebom @kdobbe @Michel @DusX @Woland @eight @mark_m @anibalzorrilla @knowtheatre @soniccanvas @jhoepffner @Maximortal @deflost @Bootzilla

I have a question that I'd like you all to weigh in on.

If you have a mono sound routed to two or more channels, the function of "pan" is clear.

If you have a stereo sound routed to two channels, the function of pan is also pretty clear: in most software, as you pan left, it reduces the right output volume and does not change the left output volume; if you pan right, it reduces the left output volume does not change the right output volume.

But what does pan mean if you have an 8-channel file routed to 8-outputs? Or a 4-channel file to 8-outputs? Or 8-channel file routed to 4 outputs?

Do you have an expectation of panning with routings like this? Frankly, it doesn't really make sense to me.

Best Wishes,
Mark

P.S. this is how the UI is looking today. I will build a version for the team to try (macOS only for the moment). I expect beta testers to have in the next couple of weeks or so.