360 video player
-
Hi all !! Is it possible to get a 360 video into isadora?
Thanks a lot !!
-
Yeah, a 360 video is just a normal video mapped to a sphere. How you do it depends a bit on the circumstance, but you’d just run the image into a 3D Player, and grab a .3ds sphere to map it to. There’s probably some spheres on the internet (I used one of a moon that I found on the forums somewhere), but it's pretty easy to make one in blender too, and you can make it exactly the size/smoothness/quality you want. You can render the 3D player directly to the stage, or use a Virtual Stage to PTZ around.
For input, I’ve built a couple systems - one just to play a 3D image/video, and one to take multiple, high-res cameras and build a live 360 panorama (that one has some issues because Isadora isn’t ready for 4K video yet, but hopefully v3 will help)
As for getting a 360 video out (to stream to a 360 viewer), I haven’t done that, but there some QC/CI actors that will help. (e.g. Circular Wrap Distortion)
Edit: Here's a simple file I'd put together to demo playing 360 photos/videos. I had it working with mouse tracking too, but can't find that patch. It was all a while ago. If I do I'll add it.
Win 10, i5 4690K, 16gb RAM, GTX 970
-
@mwasser Thank you very much !! . I couldnt download de video but just test it with the picture and works perfect. Can you explain to me the reason you set up both limit scale values different? And why the 2d control goes into the Y rotation only?
Also there were the Movie Player VR actor but may be it is not working anymore?
Thanks a lot
Maxi Wille
-
The limit scale-values scale the controller's value output (0-100) to match to the input range on the Virtual Stage and 3D Player (which are in degrees). So Tilt goes from -90 (90 degrees straight down) to +90 (straight up). Pan was -180 to +180, but the image wasn't centred, so I shifted it until it was (-160 to +200; that's the same units-to-degrees scale, but centred at +10 degrees). If you set smaller numbers, then you narrow the range of motion of the camera. Wider than this, and you can start completely wrapping around (-360 to +360, for example, would let you pan/tilt all the way around once in either direction).
You could adjust scale in the control panel too, but the 2D Slider only lets you set one scale for both x and y, and you can see that they need two different ones.
The Pan controls are on the 3D Player (Y rotation) and the tilt on the Virtual Stage (X rotation) because the frame of reference for the Y rotation doesn't change when you rotate the camera - so if you pan 90° to the left and start adjusting tilt, the model tilts as if you were still facing forward (and winds up looking like a z rotation). It's confusing - but if you just use x- and y- rotations on the virtual stage, it behaves like a tripod on its side, rather than one on the ground. I assume this makes sense for what people normally do for 3D rendering, but not for replicating a PTZ camera.
Anyway, this is a bit old - I've since found that if you flip everything on it's side (z rotation to +90 on the 3D Player and -90 on the Virtual Stage, or vice versa) and swap the controls (Pan to X rotation and Tilt to Y rotation) then it works like you'd expect (i.e. tripod on the ground). I'll try and pull that out of the complicated show patch that it's in later, and send a demo.
Win 10, i5 4690K, 16gb RAM, GTX 970
-
-
No Prob. Copying bits didn't work too well, so I just made changes to the file I'd linked to before. There's a "flipped" scene - all the control is on the virtual stage actor. Hope it makes sense/is useful. It's been way easier to work with 360 stuff in Izzy than I'd thought when I first set out, so hopefully you'll find it pretty workable too.
Win 10, i5 4690K, 16gb RAM, GTX 970
-
@mwasser thank you for all the work and the time too !!.Something strange I found when "look" down in the 360 image. There is a grey circle. Is it normal.? Im trying to attached a file but I cant.
Best,
-
Yeah, that's an issue with the texture mapping on the 3D model. The 3D model itself is just a moon that someone put together, and has some flaws. I wound up building my own model (actually multiple sphere "sections" to match the fisheye on the cameras I have, with one 3D Player per camera input).
If you need a better model, it's super simple to put a sphere together in Blender - this tutorial is probably the best since the world map is basically the same equirectangular projection as your standard 360 video, although I used this one as a reference to learn how to make my sphere sections (and I really like the guy).
You will need to include an image and a UV texture map - Isadora needs that to know how to map your input (you can see that both above tutorials would give you a sphere, but with very different ways of mapping an image). You could use the world map for this (as is in the second tutorial), or put in your own image. I put my own in since, if you disconnect video input from the 3D Player, it reverts to this as the texture - so that gave me something I could use to test even w/out video input (or could be a useful "no signal" splash).
