SignScribe

SignScribe is a web application built with Streamlit and Python that bridges the gap between sign language and spoken language communication. We plan that it utilizes three machine learning models to achieve seamless communication:

  • Sign Language Interpretation: This model interprets hand gestures captured through a webcam and converts them into corresponding words.
  • Sentence Completion/Correction: The interpreted words are then processed by another model, which constructs grammatically correct and complete sentences from them.
  • Speech-to-Sign Conversion: Finally, the completed sentences are fed into a third model, which generates real-time sign language animations for the other user to understand.

Click here to view the project source code: Link