3D objects in Isadora

[Skulpture]

Thanks for the in-depth report. This is a perfect blog post actually!

Do you have any screen recordings of the output? I am interested in the image of the right; looks like a skeleton tracking/kinect body?

[bonemap]

Thanks Skulpture,

The line figure is modelled in Isadora using the '3D line' actor - the idea was a figure that appeared formed from a continuous line. The points of the figure correspond to the skeleton tracking data from Kinect via Ni Mate and OSC. There are 24 '3D line' actors that make up the drawing. Each '3D line' has a total of six x,y,z inputs (three for each end of the line segment). The 'limit scale value' actor has been used extensively to transpose the figure to the Isadora stage. A user actor was generated to deal with a single line segment and it was then duplicated enough times to generate the outline of the figure. Each data stream has a 'smoother' actor that is embedded in the user actor, but an input for the smoothing has been routed back to a single scale value actor linking the smoothing for all of the 24 line segments.

A series of .3ds files of 'crystals' were treated in the same way, however the '3d Player' does not have inputs for a segment - so a "Calculate 3d Angle' actor was used to exchange the proximity data into rotation. The x and y data from the Kinect was then linked directly to x and y of each '3d Player'. The effect is the .3ds objects appear to tumble around the skeleton slightly in continuity with the motion capture.

I have made a screen recording of some sections of the overall project. I will be capturing a dancer and two musicians live so the patch scenes are variously motion capture, tracking and sound frequency segmentation. The projection will be mapped into a performance space. Some of the projection will be specific for 'solid light' forms that appear suspended in the performance space haze in the style of Anthony McCall - 'Line describing a cone' etc. 

Vimeo link follows:

Motion capture with Kinect Xbox 360, Ni Mate skeleton tracking and Isadora from Bonemap on Vimeo.

[Skulpture]

Wow that video is incredible. I didn't want it to end!

Very impressive. Love the circular audio responsive stuff. 

Once again - thanks for sharing. 

[DusX]

Nice work... the single line drawing is elegant.

And its nice to see more use of '3D particles'... that's such a powerful actor.. 

If you can get away from using the renderer at all.. you will see a FPS increase. CPU vid really slows down the pipeline when applied in this way.

[Clement]

Very nice work !

And thanks for sharing your experience with 3D actors, this is a part I intend to explore and your Blender tips are useful.

All the best.

Clem

[bonemap]

Thanks for the encouragement!

@DusX - I will look at avoiding the cpu-vid elements, but I don't think I can achieve these effects without the '3d renderer'. If the 'projector' actor had a video output and could be routed away from a stage - perhaps?

I am open to suggestions.

Regards,

Bonemap

[bonemap]

@ Skulpture - see the screen grab here for the missing piece! - its the 'timeslice' actor on the output of the '3d line' actor. The '3d line' actor has colour and position parameters linked to sound frequency analysis.

Regards,

Bonemap

[Skulpture]

Very clever. You are giving all your secrets away here you know ;)

I love seeing how people make patches and use effects, etc. 

I often think that Isadora patches themselves are just as impressive as the final outcome.

[bonemap]

@ Skulpture - Ha ha!

That particular arrangement of components came about from working with the '3D line' actor and the '3D particle' actor. Inspired by 'generative art' and working out a way to segment audio frequency input. I will be capturing sound from analogue musical instruments using up to eight microphones (percussion, vibes, piano) through a focusrite Clarett 8Pre audio interface. The idea is to clearly visualize each instrument as a pattern and range of colour - intentional synesthesia.

Regards

Bonemap

[crystalhorizon]

Very inspiring! Thanx for sharing your research!

[Skulpture]

+1 very inspiring stuff.

[sommerdi]

@ bonemap

I try to follow your discription above .... but i am loosing the 3ds object material info from Blender and i wasn't able to colorized the object by the '3D Light Orientation' actor ...
In case i use one 3ds object found in the web, every thing is ok. I try different blender render engine, no different ...The objects look fine  at re-import to Blender.  I am using Blender 2.76.  Do you have an idea to solve this topic?

Any hint are more than welcome ....

Diether

[bonemap]

The '3D renderer' has been replaced by the 'Virtual Stage' in version 2.1 of Isadora. The texture image file name needs to be short as it appears longer names are not supported by Isadora. The 3ds format supports 65000 vertices I have had 3D models of 45000 vertices working well in Isadora 2.2.2
https://vimeo.com/170840419

[bonemap]

Here is a link to a render of 3D object from Isadora. The 3D Player has been set to 'wireframe', however only about 50% of the model has actually rendered as a wireframe.
https://vimeo.com/171600234

[DusX]

@bonemap

I like the effect, but I imagine it was not what was intended.

Could there be anything unusual about the makeup of the file that would separate the 2 sections?

[bonemap]

Hi @DusX,

I don't know - the effect has only appeared with the 3D model neurons. These models are from the eyewire.org project to map the human brain. It could be something associated with them.

Sometimes it is the mistakes and anomalies that lead us in new directions or produce results that are unexpected and ultimately more interesting than those of our initial intentions.

cheers,

bonemap

[Skulpture]

Looks amazing!

[David]

@bonemap Hi!! Thanks so Much for this great Topic!! I've experimented with 3d player a while ago and wasn't able to have my video stream or texture cover entirely the 3d object.In the case of a more complex object that is. The texture only covered group meshes like in this video : 

The green spots are actually a line actor that reacts to sound frequencies.
It only does it on these segments.

I did this peice but would llike to go much further

or

https://goo.gl/iaDhvV
The result can be interesting but too obvious and synchronised.

Any suggestion?

I want to used transparent video files or psd.

Thank you and again great post and vimeo profile!!

[bonemap]

Hi David,

Can you give me a bit more information about your 3D model - It is hard to tell how complex it is? Is it the same model and Isadora patch in both videos?

The presentation setting in the second video looks great!  

I make an assumption that there are limitations to applying texture with the '3D Player' actor. The more complex the model the more issues arise with rendering surfaces and applying textures.

Regards,
bonemap