Skip to content

Machine Learning based Assistive Technology for Visually Impaired

Notifications You must be signed in to change notification settings

Joan947/AndroidProject

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Nina: An Object and Text Recognition Assistant for Persons with Visual Impairment using Machine Learning

This is an android application that makes use of an image and text classifier to detect and recognize objects and text and in real time using the android phones camera.The results are read out to the user for them to make their decisions after that.The image classifier is applied via a Convolutional Neural Network(CNN) trained using the MobileNets Achitecture. The object with the highest probability was read out to the user. The text classifier was implemented using an optical character recognition algorithms. A text to speech API was added to the project to read out the results to the user instantly and a speech to text algorithm was implemented for the Visually impaired individual to access the features of the application. The images for the project testing results are shown below.

SAT-SOTICS-Joana-3 SAT-SOTICS-Joana-4 SAT-SOTICS-Joana-6 SAT-SOTICS-Joana-7 SAT-SOTICS-Joana-8

About

Machine Learning based Assistive Technology for Visually Impaired

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published