Gesture control has arrived! Devices like the Myo, by Thalmic Labs, represent a huge step forward in how human beings can interact with the world around them via digital interpretation of their movements. In addition, new cloud-based services can be utilized in combination with these gesture control devices to easily add immense value to our everyday interactions.
In our session we explored how – by utilizing cloud-based integration platforms in combination with the Myo – we built and customized the foundation of J.A.R.V.I.S. (of 'Iron Man' fame) in an extremely short period of time.
Our own “Connected Parthiv” brought Tony Stark's vision to life in front of SXSW attendees. You can see his slides here, watch how it works, and get the how-to below.
How We Built J.A.R.V.I.S.
What you’ll need:
- The first thing we need to do is setup the gesture control device, in this case we used the Myo Armband. Take the extra time to train the device to your movements so it’s more accurate.
- Now we need to do something with your gestures. For this, we need to run a small piece of code on your local machine. This sends the gesture data to Built.io Flow through a webhook.
- After the gesture data is sent to Built.io Flow Enterprise, we need to decide what to do with it. For this, we have a couple different options based on what you are trying to accomplish. In this example, we are using gestures to move a map around.
- The last step is to update your endpoint (i.e. the map) with the new location and information.
We will be sharing the code and the workflow shortly. Stay tuned!
Try It Yourself
To build your own gesture-controlled assistant, give Built.io Flow Enterprise a try for free.