Novel AI-based smart glasses for the visually impaired

https://j.people.com.cn/n3/2026/0819/c95952-20490090.html

Recently, Rokid Co. has unveiled YodaOS—a native AI smart glasses operating system—and announced an end-to-end accessibility solution designed for the visually and hearing impaired. The device features a built-in visual assistance mode that integrates functions such as environmental awareness, object identification, text-to-speech, and AI-driven Q&A. It assists visually impaired users in reading materials like books, newspapers, and medication instructions.

In late July 2026, Tianshi Intelligent completed an upgrade to its AI smart glasses for visual assistance. The new product features a proprietary multimodal large language model (LLM) that runs offline on the device itself. It employs a voice system with dual modes—distinguishing between direct commands and conversational interaction—and connects to the voice channel of the “Doubao” LLM. Users can operate the device independently using only the glasses’ buttons and voice commands, without needing to pair it with a smartphone. Unlike conventional cloud-based devices, this new product can reliably perform obstacle avoidance and environmental recognition even in locations without internet access, such as underpasses or sparsely populated streets.

Hangzhou Tongxing Technology is also continuing to upgrade its “Tongzhe” AI smart glasses for the visually impaired. Late last year, the company launched its first-generation product based on the “Qwen-VL” large language model from “Tongyi Qianwen” (Qwen). The second-generation model boasts significantly improved performance and a vastly expanded range of recognizable obstacles, while response latency has been reduced from 300 milliseconds to 60–70 milliseconds. The device can identify pedestrians, vehicles, construction zones, traffic lights, and crosswalks, and can also read aloud text information such as road signs, street addresses, and bus stop signs.

According to Tong Yinfeng, a partner at Tianshi Intelligent, smart glasses for the visually impaired require professional support at every stage—from vision assessment and device selection to adaptation and usage training. High costs associated with reaching users and raising awareness also present practical challenges. Visually impaired individuals have relatively limited means of accessing information, so it takes time for them to become aware of and accept new smart assistive devices. Inclusion in the regional procurement list is merely the first step. The key challenges for the next phase are ensuring that the target users learn about the product, experience it firsthand, and actually adopt it for daily use.

Most popular posts:

This website stores cookies on your computer. These cookies are used to provide a more personalized experience and to track your whereabouts around our website in compliance with the European General Data Protection Regulation. If you decide to to opt-out of any future tracking, a cookie will be setup in your browser to remember this choice for one year. Accept or Deny