Microsoft has introduced the Seeing AI app, a breakthrough tool aimed at providing assistance to individuals with low vision. With the power of Azure AI technologies, Seeing AI has been designed to give a voice to the visual world, making it more accessible for those who have difficulty seeing. The app was unveiled at the Microsoft Ability Summit, reinforcing the company’s commitment to supporting people with disabilities.
Seeing AI operates on both Android and Apple devices, harnessing Azure AI’s capabilities to offer a variety of features that enhance daily navigation and interaction for the visually impaired. By processing images and text, the app allows users to get an auditory description of their surroundings and perform tasks such as reading printed text, identifying objects, and discerning colors and currencies.
The technologies underpinning Seeing AI include Azure GPT-4 Turbo with Vision AI, enabling the app to deliver responsive and accurate feedback. The immediate analysis and response to user prompts typically necessitate advanced computing power, but with Azure AI in the cloud, even regular smartphones can access these sophisticated capabilities. These are some of the innovative features Seeing AI provides:
– Text-to-speech: The app can audibly read out both short texts in real-time using the live camera mode and longer texts after capturing a photo and converting it.
– Barcode reader: Products can be identified quickly via their UPC codes.
– Scene descriptions: Focusing on the nearest object, the app paints a verbal picture of the environment.
– Person recognition: Seeing AI offers a description of people it detects, including their facial expressions.
– Currency identification: The app recognizes bills from 17 different countries.
– Color detection: Live photos can be used for color identification at the center of the viewfinder.
– Handwriting transcription: The app reads handwritten notes by converting them to text.
– Brightness level: An auditory tone is produced to indicate the lighting level, which varies in pitch corresponding to brightness intensity.
While the results from Seeing AI are typically accurate, it is essential to note that AI does not yet match the precision of human recognition in all circumstances. For instance, the app might erroneously identify certain objects or struggle with complex text such as mathematical equations or scientific notations.
The Seeing AI app is now available for download on both the Android app store and the Apple app store, making it easily accessible for anyone with a smartphone. Those who need additional visual assistance might also consider investing in a lighted magnifier available on platforms like Amazon.
This app marks a significant advancement in digital solutions for the visually impaired and represents an innovative use of AI technologies to foster inclusion and accessibility.
