Sorry, you need to enable JavaScript to visit this website.

You are here

Be Daring, Be Creative with Computer Vision and the Microsoft Azure Percept Devkit

BY Michelle Telstra 19 October 2021

Hey I'm XXX from Microsoft.

Technology has increasingly become a significant part of the creative process from art to sign language, all the way to architecture. Technology has enabled us to communicate with people that don't speak the same language, enabling new ways to express us through innovative art and share it with the world. This blog is written for both hobbyists and techies. If you want to learn more about what the latest computer vision innovation enables, then this blog is for you to kick start your creative juice. With Azure Percept, a secure edge AI platform with low code to no-code paths, that will allow you to start these projects with zero to none coding experience within a few hours.

Here is a list of potential projects to start. Pick up a kit and let’s go!

 

1. Daily creativity with Azure Percept

Learn and Train Sign Language

Do you have a friend or family member with speech impairment? Growing up, I asked myself how would I be able to communicate with a friend who has a speech impairment? Well, the obvious answer would have been to take a sign language class but just recently I figured out a faster way to bridge the communication with my imaginary friend. Leveraging the Azure percept Devkit I was able to build a 2-way translator allowing anyone to communicate with people effected with speech impairment and vice versa. Check out the project below! With less than 1hr, you can bring up this edge AI platform with the low-code path to train AI model to convert SL to text. Amazing, isn’t it? Now it’s waiting for you to build other direction, text to SL.

Project link: Face your fears, learn new stuff, and push out on the edges with Azure Percept - Microsoft Tech Community

 

Figure 1:  Sign Language Translator. Source link.

 

Imagine playing air guitar and hear the actual sound you play

How many times have you wanted to pick up a guitar for a local shop and start jamming? Then realizing the hassle of going through intense research to figure out the right guitar and those tough guitar strings that would give you callus for a few weeks. I probably give up halfway somewhere. Let’s get all of those of excuses out of the pictures and get you started learning guitar for real this time. Check out this link below on how you can leverage Azure Percept to build an air guitar which would then allow you to play virtual chord instead. No more excuses. How fun is it?

Project Link: https://www.linkedin.com/posts/goranvuksic_azure-azurepercept-julyot-activity-6822526760609988609-Uhc9 

Figure 2: Air Guitar. Source: link

 

Ballet Art and Emotion Detector

A fun project to see how your ballet body position is being interpreted into emotion on a digital canvas leveraging AI vision. Check out this ongoing project to see how Vision AI can help detect emotion of ballet position!

Project link: https://www.linkedin.com/posts/charleselwood_ai-artificialintelligence-art-activity-6822921171449769984-WrbZ/

Figure 3: Creative Ballet AI Training. Source: link.

 

2. Industrial IoT Use-cases with Azure Percept

Perceptmobile: Azure Percept Obstacle Avoidance LEGO Car

How many times you’ve been staring at that LEGO set and trying to come up with different creative ways to interact with it and make it into a cooler machine? Below is another way that allows you to combine latest Edge AI technology and LEGO to build "Perceptmobile", an Azure Percept-powered obstacle avoidance LEGO Boost car, as a weekend project. In this post, goranvuksic will walk you through all steps how it was built. Also, let’s think out of the box of a large warehouse scenario where robots transport loads autonomously things around and one key priority is that they find a way around obstacle. Here is an example where Goran has built a self-driving car with Azure Percept and Lego.

Project Link: Perceptmobile: Azure Percept Obstacle Avoidance LEGO Car - Microsoft Tech Community

Figure 4: LEGO Car Ostacle Avoidance with Azure Percept. Source: Link.

 

Set up your own end-to-end package delivery monitoring AI application on the edge with Azure Percept

Car manufacturing is notorious about just in time production and timely delivery is critical... or manufacturer or retailer that is waiting for things they ordered to arrive fresh produce or building materials they need for manufacturing. With this specific project, you can quickly build an computer vision with 5G (:O). Check it out!

Project Link: Set up your own end-to-end package delivery monitoring AI application on the edge with Azure Percept - Microsoft Tech Community

Figure 5: Package Delivery Monitoring. Source: Link.

 

Extra learning: 5G and Azure Percept

Hey techies and hobbyist, glad you made it all the way here. At it's core of Edge AI is connectivity. Connectivity is what makes it possible and 5G plays a critical role in this. In case the above projects didn’t keep you busy enough. Check out the instruction below to leverage your location 5G or LTE network with Azure Percept. Good luck!

Project Link: Connect Azure Percept Over 5G or LTE Networks | Microsoft Docs

 

Additional Resources

Hopefully by this session, you are excited enough and can’t wait to start your mini projects.

Information about the Azure Percept development kit can be found here: http://aka.ms/getazurepercept.

Azure Percept Studio, which allows you to connect, build, customize and manage your Azure Percept edge solutions is described here: https://aka.ms/azureperceptbuild.

Azure Percept active YouTube channel to keep you inform with the latest and greatest news: Azure Percept - YouTube.

Related Blogs

,
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • arduino

IoT Insights for Sustainable Regional Agribusiness: GovHack...

Everyone knows about Australia's world leading #agriculture exports. But lesser
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • arduino

Changes to our IoT Developer Kit Offer

Telstra is a leading IoT provider, but when building great technology solutions, sometimes less is
anonymous's picture

By Michelle Telstra

10/4/20

  • iot

Unlocking the Internet of Things with telco APIs: Telstra’s...

Originally posted on the Teleco Application Developer (TAD) 2021 Summit Blog: https://blog.
anonymous's picture

By Michelle Telstra

10/4/20

  • arduino
  • iot

Control your IoT Device remotely with SMS commands

Developing with the Internet of Things is fun. It’s challenging. It’s frustrating at
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • DIY

Home IoT Project using Azure

In this blog series, I’m going to write about how Internet of Things (IoT) enabled my
anonymous's picture

By Michelle Telstra

10/4/20

  • arduino
  • iot

Hands On: Long Range IoT Arduino MKR NB 1500 over the...

We put the Arduino MKR NB 1500 to the test using the Telstra network and show you how to
anonymous's picture

By Michelle Telstra

10/4/20

  • hackathon
  • iot

Data Driven IoT Insights for sustainable communities:...

In the second TelstraDev challenge for GovHack 2020 (part 1 on Communication APIs here), we asked:
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • captis

Capture more insights with our new Captis Data Loggers!

Calling all IoT makers and innovators, there’s a new device on our IoT Marketplace! It
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • nbiot

What's the Difference Between Cat-M1 and NB-IoT?

Here’s what our previous CFO said which is good: https://exchange.telstra.com.au/telstra-
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • platform

Telstra's IoT Platform

The Internet of Things (IoT) is a network of physical objects which collects data from the
anonymous's picture

By Michelle Telstra

10/4/20

  • iot
  • developer

Wireless Application Developers Guidelines for IoT

The Internet of Things (IoT) is an all-encompassing suite of technologies, with dozens of options
anonymous's picture

By Praveen Kumar

8/3/18

  • arduino
  • mkr

Introducing the Arduino MKR NB1500

Last year we were proud to announce our partnership with Arduino to help create an (read more about