• Products
    • Isadora
    • Get It
    • ADD-ONS
    • IzzyCast
    • Get It
  • Forum
  • Help
  • Werkstatt
  • Newsletter
  • Impressum
  • Dsgvo
  • Press
  • Isadora
  • Get It
  • ADD-ONS
  • IzzyCast
  • Get It
  • Press
  • Dsgvo
  • Impressum

Navigation

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Popular
    • Tags

    ​OSC wireless wearable sensors

    Interfacing
    8
    21
    13345
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • bonemap
      bonemap Izzy Guru last edited by

      Hi,

      I have an ongoing project that is getting a bit of additional life with the programming skills of a new friend.  
      It is a wearable multi sensor unit for dancers/movement artists that delivers OSC to Isadora.
      It uses some of the latest wireless microcontroller peripherals: 

      1 x ADXL345 accelerometer 1 x ESP8266 NodeMCU 1 x LiPo 3.7v 1200mAh 

      Hardware will draw about 70mA when connected to WiFi and the expectation is a running time of a few hours.

      The project is being developed as Open Source: https://github.com/cfreeman/Da...

      We are working towards a multi sensor prototype implementation for a show mid August.

      Here is a link to a Isadora post started by Armando that explores some of what is available in this space: https://community.troikatronix...

      Cheers

      Bonemap

      http://bonemap.com | Australia
      Izzy STD 4.2 | USB 3.6 | + Beta
      MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
      Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
      A range of deployable older Macs

      1 Reply Last reply Reply Quote 2
      • DusX
        DusX Tech Staff last edited by

        very interesting!

        I'm watching the project on github now.

        I would be interested in building a unit once a how to is available.

        Troikatronix Technical Support

        • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
        • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
        • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

        Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

        bonemap 1 Reply Last reply Reply Quote 0
        • Juriaan
          Juriaan Tech Staff last edited by

          Really cool project, also watching the project and can't wait what you guys create in the end :) 

          Isadora 3.1.1, Dell XPS 17 9710, Windows 10
          Interactive Performance Designer, Freelance Artist, Scenographer, Lighting Designer, TroikaTronix Community moderator
          Always in for chatting about interaction in space / performance design. Drop me an email at hello@juriaan.me

          1 Reply Last reply Reply Quote 0
          • bonemap
            bonemap Izzy Guru @DusX last edited by

            @DusX said:

            I would be interested in building a unit once a how to is available.

             Hi Ryan,

            OK, I will let you know how we get on.

            cheers

            bonemap

            http://bonemap.com | Australia
            Izzy STD 4.2 | USB 3.6 | + Beta
            MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
            Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
            A range of deployable older Macs

            DusX 1 Reply Last reply Reply Quote 0
            • DusX
              DusX Tech Staff @bonemap last edited by

              @bonemap

              Appreciated, 

              I'm ready to start mixing my media control ( read Isadora ) work with my costume design work.

              Troikatronix Technical Support

              • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
              • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
              • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

              Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

              1 Reply Last reply Reply Quote 1
              • mark_m
                mark_m last edited by

                Very interesting indeed! You have my attention!

                Intel NUC8i7HVK Hades Canyon VR Gaming NUC, i7-8809G w/ Radeon RX Vega M GH 4GB Graphics, 32GB RAM, 2 x NVMe SSD
                Gigabyte Aero 15 OLED XD. Intel Core i7-11800H, NVidia RTX3070, 32GB RAM 2 x NVMe SSD
                PC Specialist Desktop: i9-14900K, RTX4070Ti, 64GB RAM, Win11Pro
                www.natalieinsideout.com

                1 Reply Last reply Reply Quote 0
                • bonemap
                  bonemap Izzy Guru last edited by bonemap

                  Hi,

                  We have the wireless sensors up and running. I have added a infrared LED for position/proximity tracking. 

                  Still at the prototype stage but ready for use in production.
                  The range has been tested with a 2.4ghz wireless router at 40 metres with no indication of degraded performance. The battery life has exceeded six hours of non-continuous use.

                  There is a 'how to' here: https://reprage.com/post/Dance...

                  The code for the board and Isadora patches are here: https://github.com/bonemap/Dan...

                  We are using AtomIO and PlatformIO to update the code on the board using the NodeMCU's micro USB port, including the wireless settings SSID/password/port info etc. https://atom.io/, http://platformio.org/

                  Lots of possibilities for this unit. For example, it can be wearable (see image below), attached to a physical object (hoops, tubes, boards, trapeze, costumes etc.) to track its orientation and multiple devices can be used simultaneously with unique OSC streams for X,Y, Z movement, vibration and rotation. The IR LED has potential to provide proximity using a separate camera tracking set-up and when not occluded. A future prototype will mount the IR LED in a thimble or plectrum so that it extends to the tip of a finger and is less often occluded when the sensor unit is worn on a hand.


                  Short video here... but will post with a video of the unit in production soon...

                  https://www.dropbox.com/s/kg3a...

                  http://bonemap.com | Australia
                  Izzy STD 4.2 | USB 3.6 | + Beta
                  MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                  Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                  A range of deployable older Macs

                  DusX bonemap 2 Replies Last reply Reply Quote 0
                  • DusX
                    DusX Tech Staff @bonemap last edited by DusX

                    @bonemap

                    I will build a copy once I return from the werkstatt. Very much into this.

                    Perhaps it's noted (haven't read the how to yet) what language is being used for the micro processor coding?

                    Update... checked the github and see the code is c++ ☺

                    Troikatronix Technical Support

                    • New Support Ticket Link: https://support.troikatronix.com/support/tickets/new
                    • My Add-ons: https://troikatronix.com/add-ons/?u=dusx
                    • Profession Services: https://support.troikatronix.com/support/solutions/articles/13000109444-professional-services

                    Running: Win 11 64bit, i7, M.2 PCIe SSD's, 32gb DDR4, nVidia GTX 4070 | located in Ontario Canada.

                    1 Reply Last reply Reply Quote 0
                    • C
                      CarlMDB last edited by

                      Is there a possibility of creating a similar function using this on a smartphone?  Isn't a smartphone already a wifi transmitter and has an accelerometer? 

                      I'm a novice, just wondering.. 

                      bonemap 1 Reply Last reply Reply Quote 0
                      • bonemap
                        bonemap Izzy Guru @CarlMDB last edited by bonemap

                        @CarlMDB said:

                        Isn't a smartphone already a wifi transmitter and has an accelerometer

                        Hi @CarlMDB,

                        Thank you for your comment. I take your point, and short answer is yes these units are an alternative to an expensive smartphone/ipod that has the same functionality. However, this is much lower cost per unit and can be used with multiple units simultaneously, is lighter, simpler, can be incorporated into props, costumes and we have the satisfaction of building something ourselves. I have 6 x prototypes of these devices for component cost of under US$20 each, not sure that I would be able to get 6 smartphones for the same price point and have as much flexibility of how they can be integrated into use. Smartphones do a lot more than these units so I am not sure that the comparison is worthwhile. I can imagine a performer wearing a bunch of smartphones and that has the potential to tell particular visual narratives. What is the visual narrative that these devices tell? I think it is a bit different if only that we have engaged in the agency of making the device ourselves.

                        regards

                        bonemap

                        http://bonemap.com | Australia
                        Izzy STD 4.2 | USB 3.6 | + Beta
                        MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                        Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                        A range of deployable older Macs

                        1 Reply Last reply Reply Quote 1
                        • C
                          CarlMDB last edited by

                          "we have the satisfaction of building something ourselves"

                          I completely understand this. 

                          I am a member of SOPWAMTOS: "Society of People Who Actually Make Their Own Shit ".  I imagine many Isadora users are as well. 

                          bonemap 1 Reply Last reply Reply Quote 1
                          • bonemap
                            bonemap Izzy Guru @CarlMDB last edited by

                            @CarlMDB said:

                            SOPWAMTOS: "Society of People Who Actually Make Their Own Shit ".

                             Thanks for that - I love it!

                            regards,
                            bonemap

                            http://bonemap.com | Australia
                            Izzy STD 4.2 | USB 3.6 | + Beta
                            MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                            Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                            A range of deployable older Macs

                            1 Reply Last reply Reply Quote 0
                            • Skulpture
                              Skulpture Izzy Guru last edited by

                              This is very cool. Following closely! 

                              Graham Thorne | www.grahamthorne.co.uk
                              RIG 1: Custom-built PC: Windows 11. Ryzen 7 7700X, RTX3080, 32G DDR5 RAM. 2 x m.2.
                              RIG 2: Laptop Dell G15: Windows 11, Intel i9 12th Gen. RTX3070ti, 16G RAM (DDR5), 2 x NVME M.2 SSD.
                              RIG 3: Apple Laptop: rMBP i7, 8gig RAM 256 SSD, HD, OS X 10.12.12

                              1 Reply Last reply Reply Quote 0
                              • eight
                                eight last edited by

                                @bonemap What's the positional drift rate on these devices? Last time I checked the accelerometers were not better than about 1m per 1 minute, which really was a stopper for me.

                                Thanks for sharing!

                                Analysis: http://post.scriptum.ru | Synthesis: http://onewaytheater.us
                                Twitter: https://twitter.com/eight_io | Flickr: http://www.flickr.com/photos/eight_io/
                                Github: https://github.com/eighteight | MulchCam: https//mulchcam.com
                                MulchTune: https://itunes.apple.com/us/app/mulch-tune/id1070973465 | Augmented Theatre: https://augmentedtheatre.com

                                bonemap 1 Reply Last reply Reply Quote 0
                                • bonemap
                                  bonemap Izzy Guru @eight last edited by bonemap

                                  @eight said:

                                  the positional drift rate

                                  These accelerometers do have some drift, but I would be surprised if it is to the extreme that you have described. I have used them for extended periods (over 6 hours continuous) with negligible issues with drift, however I would not say there is no drift. They appear to be much better than the accelerometers I have been using since 2011. The way I am using them currently does not require accurate tracking of position over time or distance. I am using numerical decay and smoothing that responds to the force of directional movements, rotation and orientation of the device. These are like exaggerations of directional movement that are always trying to decay back to the raw reading of the accelerometer data. The numerical data is filtered and passed to numerous 3D player assets that flock and swarm synchronized with rotation and direction of the performers hand movements. The spatial representation of these swarms as projections tracking over physical distances is not going to be achieved with the accelerometer data. There are a couple of other options for spatial tracking, one is a camera vision system that tracks IR LEDS mounted on the device (reducing the battery duration significantly), the other is Bluetooth triangulation (there appears to be a Bluetooth beacon on the NodeMCU) however, the programming task of implementing the Bluetooth option is out of my reach. 

                                  Cheers,

                                  bonemap

                                  http://bonemap.com | Australia
                                  Izzy STD 4.2 | USB 3.6 | + Beta
                                  MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                                  Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                                  A range of deployable older Macs

                                  Woland 1 Reply Last reply Reply Quote 0
                                  • bonemap
                                    bonemap Izzy Guru last edited by bonemap

                                    Hi,

                                    This crowd funded project may be of interest to anyone looking at wearable sensors: synapseWear

                                    regards

                                    bonemap

                                    http://bonemap.com | Australia
                                    Izzy STD 4.2 | USB 3.6 | + Beta
                                    MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                                    Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                                    A range of deployable older Macs

                                    1 Reply Last reply Reply Quote 2
                                    • bonemap
                                      bonemap Izzy Guru @bonemap last edited by bonemap

                                      @bonemap said:

                                      post with a video of the unit in production

                                       An update to the post with a video representation of the wearable sensors in action. I was sick with the flu when this was running, so I have relied on low res 'quick and dirty' social media video documentation made by audience members. It is one scene in the work.


                                      In this iteration the dancer is wearing three of the ESP8266 based wifi modules with accelerometers sending data to Isadora. One is incorporated into a chest plate shaped as a rib cage and another two - one for each hand. In the video, the chest mounted module is affecting the orientation of the 3D shader ("Seascape" by Alexander Alekseev aka TDM - 2014) using custom Isadora GLSL shader inputs. The two hand accelerometer modules provide data for the 'twig' like 3D objects. The wave height of the Seascape shader is also linked to the sound frequency of the analogue harp music captured with a pick-up. The work was presented in a carpark September 2017.

                                      We are looking at the next stage prototype now that might use some form of (wifi, bluetooth or NFC) signal strength detection to develop proximity data between the modules, in an attempt to get autonomous relational data streams from the body (centre of gravity) and the limbs (as orbiting/satellite/moving points). 

                                      The other direction we are exploring is a module with interchangeable sensor components that get 'designed' into a custom PCB board and wearable enclosure. I am very interested in a modular system that can be used as a flexible solution - not just wearable - but also mountable. For example these thermal imaging sensors mounted for motion tracking which means looking into wireless video on the ESP8266. If anyone has already tried this it would be great to hear about it.

                                      Best Wishes

                                      bonemap

                                      http://bonemap.com | Australia
                                      Izzy STD 4.2 | USB 3.6 | + Beta
                                      MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                                      Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                                      A range of deployable older Macs

                                      1 Reply Last reply Reply Quote 2
                                      • bonemap
                                        bonemap Izzy Guru last edited by

                                        Hi,

                                        Here is another approach from the UK: MiMu gloves

                                        Best Wishes

                                        bonemap

                                        http://bonemap.com | Australia
                                        Izzy STD 4.2 | USB 3.6 | + Beta
                                        MBP 16” 2019 2.4 GHz Intel i9 64GB AMD Radeon Pro 5500 8 GB 4TB SSD | 14.5 Sonoma
                                        Mac Studio 2023 M2 Ultra 128GB | OSX 15.3 Sequoia
                                        A range of deployable older Macs

                                        Woland 2 Replies Last reply Reply Quote 0
                                        • Woland
                                          Woland Tech Staff @bonemap last edited by

                                          @bonemap said:

                                          Here is another approach from the UK: MiMu gloves

                                          I think I'm in love!

                                          Unfortunately, I can't afford to buy any more equipment at the moment. Fortunately, they're not in stock right now so the state of my bank account doesn't matter. Wish I knew how much they cost though...

                                          Best wishes,

                                          Woland

                                          TroikaTronix Technical Support
                                          New Support Ticket: https://support.troikatronix.com/support/tickets/new
                                          Support Policy: https://support.troikatronix.com/support/solutions/articles/13000064762
                                          Add-Ons: https://troikatronix.com/add-ons/ & https://troikatronix.com/add-ons/?u=woland
                                          Professional Services: https://support.troikatronix.com/support/solutions/articles/13000109444

                                          | Isadora Version: all of them | Mac Pro (Late 2013), macOS 10.14.6, 3.5GHz 6-core, 1TB SSD, 64GB RAM, Dual AMD FirePro D700s |

                                          1 Reply Last reply Reply Quote 1
                                          • Woland
                                            Woland Tech Staff @bonemap last edited by

                                            @bonemap said:

                                            the other is Bluetooth triangulation (there appears to be a Bluetooth beacon on the NodeMCU) however, the programming task of implementing the Bluetooth option is out of my reach

                                            I may know someone who might be able to help with that. I'll DM you some info.

                                            Best wishes,

                                            Woland

                                            TroikaTronix Technical Support
                                            New Support Ticket: https://support.troikatronix.com/support/tickets/new
                                            Support Policy: https://support.troikatronix.com/support/solutions/articles/13000064762
                                            Add-Ons: https://troikatronix.com/add-ons/ & https://troikatronix.com/add-ons/?u=woland
                                            Professional Services: https://support.troikatronix.com/support/solutions/articles/13000109444

                                            | Isadora Version: all of them | Mac Pro (Late 2013), macOS 10.14.6, 3.5GHz 6-core, 1TB SSD, 64GB RAM, Dual AMD FirePro D700s |

                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post