Abto Software took part in an ambitious competition to design a model to recognize and classify ASL signs, aimed at education gamification.
Having covered initial discovery, approach determination and evaluation, our team created a TensorFlow Lite language model, trained on data extracted using the MediaPipe Solution.
To allow the algorithm to run across devices and limit the latency, the videos aren’t stored on a public cloud. That means the inference must be smoothly conducted on the user’s device.
The project's main goals:
The stages our team has covered:
Opportunities:
The designed ASL model is optimized for deficient internet connection, which makes it suitable for use even in developing countries.
The described ASL model isn’t using original input (user video’s), which preserves patient security and privacy and ensures regulatory compliance.
With integrated ASL recognition into products and services, people with hearing loss can enjoy:
Read more about this case: https://www.abtosoftware.com/portfolio/cv-enabled-american-sign-language-recognition