Hi there! I work as an audio engineer in theater, and I wanted to be able to precisely control other departments, such as lighting and video, along with audio. I was really unhappy with the existing options, so I decided to build my own Max for Live devices.

If you are running a show with Ableton / M4L & Isadora, these devices might be just as useful for you.

There are two devices online, until now:

Liveaudio 2 OSC:

This plugin allows you to send OSC values to Isadora, depending on the incoming audio. For example, you can apply it to the brightness level of your projection: the louder the incoming audio, the brighter the projection. You can also use it for zoom, color, position, and more.

Audio-Automation 2 OSC:

With this plugin, you can use four different strings to send four different values to Isadora. For example, you can apply them to the brightness level of your projection simply by writing automations on your audio track. You can also use them for zoom, color, position, and much more.

Here are some videos, to explain, what the devices do: https://youtube.com/playlist?l...

I really hope this is useful for you and that you have a lot of fun using it!

Cheers, Alex

@woland Many thanks L! Hopefully it’s possible.

Best wishes Simon

@paz

I asked him about it and will let you know if we can get the file uploaded to the YouTube description and/or Add-Ons Page.

Hello! Once again I'd like to say a HUGE thank you to the TroikaTronix team for the amazing new audio features that have been brought to us with Izzy 4.5!

I've just viewed the video that @mark has recently uploaded to the TroikaTronix YouTube channel showcasing some of the new audio features. It's great to watch and makes clear how many of the new features are designed to be used. It's much appreciated.

Is it possible for the Isadora file that Mark uses during the video to be accessed? I wanted to follow along with the video, however there's a Pythoner actor being used so it would be great to have access to this code.

Many thanks and best wishes,

Simon

@emullis

Actually, if you humor me one more time, there's one thing we didn't try. Based on the fact that you stated this same setup used to work for you with an older version of Isadora, we should try that.

Can you:

1. In Isadora, go to Help > Open Plugins Folder > TroikaTronix Actors Plugins
2. Select everything in that folder, then right-click one of them and select "Compress"
   1. You'll get a .zip file that you can later unzip and use to restore the contents of this folder later if need be
3. Delete everything except the zip from that folder
4. Quit Isadora
5. Install an older version of Isadora using our Legacy Downloads Page (I'd suggest starting with 4.1.1 and working backwards)
   1. If you want to keep the recent version of Isadora on your computer too, see this article on how to install multiple versions of Isadora on your computer
6. Try streaming data from Rokoko again with each older version of Isadora and see if any of them are stable with your v2 suit.

One other idea, that unfortunately requires different hardware, is seeing if a Windows computer running Rokoko Studio and Isadora is stable for you. I know this worked for an artist I collaborate with in the UK who uses a v2 suit.

@emullis said:

Since the problem does not seem to be resolvable and the project is for a dance solo that will tour this fall, I will need to procure another software to stream to. This is unfortunate. 

 Understandable. Sorry we weren't able to solve this in time for you. Hopefully we'll be able to pin this down and fix the issue for a future release.

@woland

An update:

- I downloaded Izzy 4.5, and the brand new version of Rokoko Studio. I also updated my OS to Tahoe 26.5.2
- I used a different SmartSuit Pro II (borrowed from a friend) to record new mocap data in Studio.
- Izzy continues to consistently crash. 

Since the problem does not seem to be resolvable and the project is for a dance solo that will tour this fall, I will need to procure another software to stream to. This is unfortunate. 

@dusx

Thank you. Managed to do this with the help of Claude Sonnet 4.6  which showed me how to retrain the data using something which has the same landmarks as in your Mediapipe pose tracking examples.
This seems to work very well, thank you. 

Not sure how to share the process? 

I took maybe 25 photos of each of 14 poses (yes, different handstand shapes, of course!)

Then organised them into this folder structure

training_data/
    arms_crossed/
        photo1.jpg
        photo2.jpg
        ...
    arms_raised/
        photo1.jpg
        ...
    lunge_left/
        ...

And then followed Claude's instructions. 

Here's my Colab notebook:
https://colab.research.google....

After I'd successfully trained that and got the files out the other end...

It then gave me the python mediapipe code. 
https://www.dropbox.com/scl/fi...

And that outputs the OSC into Isadora. Two streams, one telling me which pose it is, and the other giving me the confidence about it.

Hope this is useful to someone!!!

Cheers

Mark (not that Mark, who I'm sure doesn't use Claude to do his coding!)

@mark_m

I haven't gone through this in some time. I will go through this tomorrow, and see what needs to be updated to make the process smooth once again. My gut tells me it would be better to use the current format/s supported by Teachable Machine, and update the libs / code used to work with the current format.

Hello Isadormobiles,
I've been following @Andy-Carluccio 's  tutorial on Teaching Isadora to recognise images, object, people, which is here:
https://support.troikatronix.c...

I've run into a couple of issues - perhaps not surprising, as Andy wrote this five years ago!
1. The tensorflow models produced by Teachable Machine are now in .js format, not the .h5 that Andy's NDI Classify program wants.
With help from Claude AI I did convert the Tensorflow model to .h5

2. When I run the NDI_classify.exe I briefly see a window flash open, and that's it. No dialogue box as expected. Tried on two different PCs, so... 
@Andy-Carluccio in the instructions it says "run NDI-Classify.exe" I didthis just by double clicking. Is there a particular way I should be running it?

Time has moved on, and perhaps this is no longer the best way to achieve this? I have this well trained tensorflow model which I want to use in Isadora to trigger events when the different human poses are detected. Shape A triggers event A, Shape B triggers event B, etc.

Any thoughts on this? 

Thanks all!!


Mark (not...)