[NYC21]

Fingerspelling with Machine Learning [DRAFT]



 
Image Credit : Hello Monday

Website

Instagram

Silver 

Project Overview

To address language deprivation and help bridge the communication barrier between the deaf and the hearing, we partnered with the American Society for Deaf Children to create Fingerspelling.xyz.

Project Commissioner

American Society for Deaf Children

Project Creator

Hello Monday

Project Brief

Every year 2 - 3 out of every 1,000 children born in the US are deaf or hard-of-hearing. 90% of these children are born to hearing parents, and in many cases, their child is the first deaf person these parents have ever encountered.

Project Innovation/Need

Without being introduced to sign language at an early stage, a deaf child may miss out on learning language. This can lead to language delay or deprivation, which has long-term negative impacts on a child’s life. That is why it is so important that parents of deaf children have the opportunity to learn American Sign Language (ASL) as soon as possible.

When you sign the word, the camera tracks your hand movements and gives you feedback so you can make corrections as needed. This helps you quickly develop your fingerspelling skills.

Fingerspelling.xyz is a browser-based app that uses a webcam and machine learning to analyze your hand shapes so you can learn to sign the ASL alphabet correctly.

The fingerspelling game is a great way to introduce the basics of ASL in a fun and playful way. It guides you step by step in how to master fingerspelling - hands on!




Projects that expand and grow the inclusion, integration, diversity and community.
More Details