• Isadora
  • Get it
  • Forum
  • Help
  • ADD-ONS
  • Newsletter
  • Impressum
  • Dsgvo
  • Impressum
Forum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    [ANSWERED] Augmented Reality

    How To... ?
    2
    3
    343
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • R
      rosa last edited by Woland

      Dear Forum,

      is there a way to set up augmented reality features with isadora?

      f.e. filming the person standing in front of a video screen as if it were a mirror and letting stuff appear in the picture / on their face / their body?


      Thank you!

      Rosa

      Fred 1 Reply Last reply Reply Quote 0
      • Fred
        Fred @rosa last edited by

        @rosa you can do some rudimentary stuff using the openNi actors and any of the supported depth cameras. The skeleton tracking will give you coordinates of the body parts (you can use these to add an animated layer in the correct position and layer it over the colour video stream of the depth camera. The biggest limitation is that the cameras will most likely have to be fixed and the resolution that the depth and skeleton tracking outputs from the openNi actor is 640*480. There is no way to accurately calibrate another higher quality video stream from another camera to the stream from the depth camera.

        You could use more advanced tracking like a mocap system (tracking both the person and the camera) to resolve the coordinates but the tools for doing this are expensive and require some layers of intermediate processing outside of the abilities of Isadora.

        http://www.fredrodrigues.net/
        https://github.com/fred-dev
        OSX 10.15.15 MBP 2019 16" 2.3 GHz 8-Core i9, Radeon Pro 5500M 8 GB, 32g RAM
        Windows 10 7700K, GTX 1080ti, 32g RAM, 2tb raided SSD
        Windows 10 Threadripper 3960x 64g ram, 1tb NVME, rtx 2080ti + rtx2070 super

        R 1 Reply Last reply Reply Quote 1
        • R
          rosa @Fred last edited by

          @fred thank you!!

          1 Reply Last reply Reply Quote 0
          • First post
            Last post