Technology has the power to do many things, and changing the world is one of them. And right now, there is an opportunity for us to help verbally challenged people to communicate with the common people. We recognise that technology alone cannot fix everything but technology can help bridge the gaps. This project is an effort to create solutions to address the challenges faced by verbally challenged people on a daily basis.
The desired outcome of this project is to create an open source asset that can have measurable impact on the problem statements listed in this repository.
Project ISL(Indian Sign Language) is one of the initiatives where we are trying to give it back to the society. This is a project where developers code for a cause. With this project, we are trying to address the problems that verbally challenged(deaf and dumb) people go through every day. Verbally challenged people communicate using sign languages and the most commonly used sign language in south Asian countries is ISL(Indian Sign Language). While there are solutions using which we are recognising sign language but there are no standard solutions that are accessible to everyone. To address this problem, we are proposing Project ISL. The idea is to create a platform where verbally challenged can talk to regular people(and vice versa). Our plan is to infuse AI/ML techniques and create open and standard models that are publicly accessible for everyone to consume and perform translation from ISL to local languages in India(and vice versa).
-
Engage
- Understand the problem statements that are listed under this Github repository
- Reach out to us and stay connected if you want to get involved in our activities
-
Contribute
-
Steps to contribute
- Fork the repo
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Added some feature') - Push to the branch (
git push origin my-new-feature) - Create new Pull Request
-
Verbally challenged people don't have a standard system using which they can communicate with people that use various common languages like English.
-
People who are working on translation systems for sign languages to common languages(and vice versa) don't have standard APIs/services to consume.
-
Creating secure translation models where we don't have to worry about model poisoning, Inference, Extraction, Evasion.
-
Verbally challenged people require a medium using which they can communicate with the ones who don't understand sign language, and vice versa.
-
NGOs, agencies and educational institutes require a way using which they can communicate to verbally challenged who talk sign language.
-
Training a model that can perform this translation could bridge the gap in the current ways.
-
Indian Sign Language translator using Neural Machine translation
-
Indian sign language (ISL) gestures for deaf and dumb people
- Here is a research project called ISL
- A deep learning model that recognise alphabet, vocabulary and sentences in ISL and translate them into native languages like English, Hindi, Telugu etc
Here are a couple of datasets we gathered
-
Citizens
- Citizens who are verbally challenged
- Citizens who want to communicate with verbally challenged
- Citizens who are working for an agency that works with verbally challenged
-
NGOs and Educational Institutes for Specially Abled
- Educational Institutions who have verbally challenged students
- Agencies and Non Profit Organisations that are working with verbally challenged people
-
While there are many organisations working on sign languages, there are no standard APIs and services that are available for developers to readily consume and build a solution.
-
This problem statement aims to create a service/APIs that can be consumed by the developers/organisations working with ISL. This also aims at creating standard and reliable browser extensions, web interfaces for the models created Problem Statement 01.
-
Creation of mobile/web applications and avatars that help users to understand ISL can add on to this project's mission.
- A chrome extension that converts text to ISL.
- A web/mobile application that calls the models created in the first problem statement and shows the translated text using avatars.
- Application developers
-
Developers who are building something around ISL
-
Developers who are looking for APIs to instantly consume and perform translation
- Agencies working on Indian Sign Languages
-
Agencies who are building applications for ISL
-
Agencies that want to provide an interface for verbally challenged people within their organisation
-
Animation system for Indian Sign Language communication using LOTS notation
-
SignQuiz: A Quiz Based Tool for Learning Fingerspelled Signs in Indian SignLanguage Using ASLR
-
Machine learning model security is one of the major areas that should be considered while creating models.
-
Application security is one of the areas we are looking for. Since this is an opensource project and developers are welcome to commit their piece of code. While they commit their code, we would definitely want contributions around app sec practices.
- Various test scripts that can check the application created
- Everyone involved must make sure their code is secure before committing and that's when we will merge the code they have submitted
This repository contains:
If you would like to see the detailed LICENSE click here.
- Authors: Amol Dhondse([email protected]), Rachana Vishwanathula([email protected])
Copyright:: 2020 - IBM India, Inc
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.