Interactive Deformable Colored Sound Display Achieved with Electrostrictive Fluoropolymer and Halide Perovskite.

Area of Science:

• Materials Science
• Human-Computer Interaction
• Acoustics and Optics

Background:

• Intersensory facilitation, the synergy between senses like color and sound, enhances human cognition.
• Soft human-machine interfaces (HMIs) primarily offer unisensory output, with limited exploration of combined optic and acoustic expression.
• Integrating sound and light in a single device is challenging due to differing material principles and implementation strategies.

Purpose of the Study:

• To develop a deformable device capable of synchronized, multi-color light and sound generation.
• To overcome the limitations of current soft HMIs by creating a unified optic-acoustic display.
• To demonstrate a novel approach for integrating visual and auditory feedback in human-machine systems.

Main Methods:

• Development of a deformable sound display based on alternating-current electroluminescence (ACEL) integrated with perovskite composite films.
• Utilizing the ACEL's polymer matrix to generate sound waves.
• Producing multi-color light through perovskite films and the blue electroluminescence from ACEL phosphors.

Main Results:

• The device successfully generates large sound and multiple colors at low input voltage.
• Patterning different colored perovskite films enabled distinct color-sound associations.
• Demonstrated applications include a piano keyboard and a wearable interactive device showcasing synchronized optic-acoustic output.

Conclusions:

• A novel deformable sound display integrating synchronized color and sound generation has been successfully developed.
• This technology offers a new pathway for creating advanced HMIs with combined sensory feedback.
• The device's ability to associate color with sound opens possibilities for enhanced cognitive interaction and user experience.