Microsoft Research Labs have yesterday released a new app called Seeing AI that narrates the world around you. It uses Machine Learning (ML) and Artificial Intelligence (AI) to read and detect objects or persons and then reads out what they are using a Speech library. The app is designed for the blind and low vision community of users and is an ongoing research project that is aimed to harness the power of AI.
The app features six different modes to read things around you:
Short Text
With this mode, the app helps you read short strings of text, such as signs or labels on things.
Documents
This mode works like an OCR mode on a page and provides audio guidance to capture a printed page. This mode captures and recognizes the text, along with its original formatting.
Products
This mode looks for barcodes and identifies products for you.
Person
Using Facial Recognition, this mode recognizes friends or family for you, and even tells you what emotions they’re currently exhibiting. You can add photos of people you know in the app, so the app recognize the person and can also use the name you entered.
Scene
This mode is an experimental feature that describes the scene around you. In our testing, it didn’t work very well.
Currency
The currency mode is an upcoming feature that will help users identify currency notes and bills.
The app works really well and has been crafted with audio beeps and feedback for better usability.
Microsoft’s Seeing AI App for the Blind and Visually Impaired
Seeing AI is a Free app and available for Free on the iOS App Store.
