"Be My AI: A Visual Assistant Based on Artificial Intelligence, Helping Blind Users See the World"

Be My Eyes is an innovative mobile application that connects visually impaired users with sighted volunteers to provide visual assistance. The application has been launched and is now available for testing to hundreds of thousands of iOS users. Be My AI, utilizing OpenAI's advanced artificial intelligence image recognition technology called GPT-4V, provides detailed descriptions of photos taken by blind users to help them with daily tasks and various situations. This feature has started rolling out this week and will gradually be made available to existing Be My Eyes iPhone application users in the coming weeks. Blind users simply need to open the app, tap on the Be My AI tab, take a photo, and receive real-time detailed voice descriptions. Users can also ask follow-up questions for more information. According to Be My Eyes, common use cases during testing include reading packaging, manuals, and appliance controllers, as well as obtaining descriptions of the surrounding environment, artwork, and social media images. It also provides written responses in 29 languages to assist users who are deaf-blind. Be My AI represents a significant advancement in making visual information more accessible to the blind community. However, Be My Eyes emphasizes that it does not aim to replace essential mobility tools such as white canes or guide dogs. The application also connects users to human volunteers for visual assistance when needed. Be My AI has been in development for seven months, incorporating feedback from over 19,000 blind testers to improve user experience. While the accuracy of artificial intelligence continues to improve, Be My Eyes acknowledges that early-stage AI may still have some errors. They encourage users to provide feedback to enhance the system. The feedback from the blind community has played a crucial role in shaping this innovation. One user named Sarah shared her experience, stating, "Chat GPT seemed like a distant tool, but when integrated into Be My Eyes, I decided to give it a try. It has been very valuable in describing images that are rarely described on social media platforms." The Android version will also undergo testing in the coming months. With over 6.9 million volunteers, Be My Eyes hopes that this latest feature will further their goal of making the world more accessible. While artificial intelligence has its limitations, Be My AI represents an exciting new option for obtaining visual information without manual operation. This provides greater independence and convenience for blind and visually impaired users in their daily lives. As the first major integration of artificial intelligence in Be My Eyes, it likely foreshadows more accessibility-focused innovative AI applications to come.