Humanoid Intelligent Display Platform for Audiovisual Interaction and Sound Identification.

Area of Science:

• Materials Science
• Human-Machine Interfaces
• Artificial Intelligence

Background:

• Developing advanced human-machine interfaces requires materials with humanized mechanical properties and intelligent functionalities.
• Existing interfaces often lack the necessary flexibility and responsiveness for seamless interaction in diverse environments.

Purpose of the Study:

• To design, fabricate, and integrate a humanoid intelligent display platform (HIDP) with skin-like mechanical properties.
• To enable audiovisual interaction and accurate animal species identification using machine learning and IoT.
• To explore applications in soft robotics, wearable systems, and assistive devices.

Main Methods:

• Fabrication of a sandwich structure using stretchable silicon elastomer and silk fibroin ionoelastomer.
• Integration of a light-emitting layer and surface electrodes for display capabilities.
• Implementation of machine learning algorithms and Internet of Things (IoT) for audiovisual interaction and species identification based on sound amplitude and frequency.

Main Results:

• The HIDP exhibits highly stretchable and resilient, skin-like mechanical properties suitable for extreme environments.
• Accurate identification of animal species from sounds reached approximately 100% accuracy over 200 tests.
• Real-time recognition of animal species and their frequencies achieved accuracies of ~99% and ~93%, respectively.

Conclusions:

• The study presents a viable strategy for creating intelligent display devices with audiovisual interaction capabilities.
• The developed HIDP demonstrates potential for advancing human-machine interaction, soft robotics, and medical devices.
• This work paves the way for more integrated and responsive smart display technologies.