Recognition of pixelized Chinese characters using simulated prosthetic vision

The rehabilitation of the reading ability of the blind with a limited number of stimulating electrodes is regarded as one of the major functions of the envisioned visual prosthesis. This article systematically studied how many pixels of individual Chinese characters should be needed for correct and economic recognition by blind Chinese subjects. In this study, 40 normal-sighted subjects were tested on a self-developed platform HanziConvertor (Institute for Laser Medicine & Bio-photonics, Shanghai Jiaotong University, China) with digital imaging processing capacities to convert images of printed text into various pixelized patterns made up of discrete dots, and present them orderly on a computer screen. It was found that various complicated factors such as pixel number, character typeface, stroke number, etc., can obviously affect the recognition accuracy. It was also found that optimal recognition accuracy occurs at a specific size of binary pixel array, due to a trade-off between a strictly limited number of stimulation electrodes and character sampling resolution. The results showed that (i) recognition accuracy of pixelized characters is optimal with at least 12 x 12 binary pixels, and therefore it is recommended to apply a minimum of 150 discrete and functioning electrodes for restoring the reading ability of blind Chinese individuals in the visual prosthesis; (ii) fonts of Song Ti and Hei Ti are clearer and more effective than other typefaces; and (iii) characters with fewer strokes lead to better accuracy.