https://english.news.cn/20260820/913e9e7e73434b869e6019187f9c0bcb/c.html

https://www.nature.com/articles/s44460-026-00122-3

A research team of Nanjing University and the National University of Singapore has developed a new type of vision chip that directly converts light into tokens, bypassing the multiple processing steps that typically consume power and slow down performance. Unlike conventional sensors, which capture light and then digitize, buffer, and transfer data before token generation, the new device performs the conversion in the physical domain.

It features an array of specialized pixels, each capable of simultaneously sensing light, storing data locally, and performing computations. The chip’s peripheral circuits can selectively activate pixel regions to divide an image into blocks. For each selected block, a specific voltage sequence is applied, enabling the stored optical information to carry out mathematical operations directly in the analog domain, with the output current serving as the token.

A “Light comes in, tokens come out” turns the chip from a passive image recorder into an active visual-semantic generator. In tests, a system using the chip achieved 87.3 percent accuracy in image recognition, close to conventional software baselines, while improving energy efficiency by more than 10 times during the tokenization stage.

The technology could provide a highly efficient, near-zero-latency vision foundation for embodied intelligence, drones and smart security, accelerating the large-scale deployment of physical AI.