← Back to Articles
⚠️
IEEE Published Article
This article is published by IEEE and the copyright belongs to IEEE. Please click here to access the full text.

Overall Design and Physical Validation of Voice Interaction Based on the ChatGPT Humanoid Robot Brain

View PDF

Abstract

Aimed to the challenge of robotic voice interaction, this study leverages ChatGPT (chat generative pretrained transformer) technology to develop a humanoid robot solution with a central processing system. Employing a top-down design approach, the solution encompasses the design of voice, video, and motion streams between users and the robot, enabling voice communication and expression output. By integrating hardware devices and a central control system, the entire humanoid robot system achieves a twofold purpose. On one hand, it combines data from conversational context, user tone and emotion, and user facial expressions to appropriately exhibit expressions. On the other hand, it formulates reasonable voice responses in conjunction with extracted statement content and emotional cues. Lastly, two physical prototypes of the humanoid robot are constructed. Experimental trials are conducted to assess the voice conversation and expression output capabilities of the humanoid robot, thereby confirming the rationality and effectiveness of the proposed solution.

Keywords

Humanoid robot ChatGPT voice interaction expression output

Authors

Z. Li
CATARC, Automotive Test Center (Ningbo) Co., LTD, Ningbo, China
L. Yan
Research and Development Laboratory, Amileyuan Intelligent Technology (Beijing) Co., LTD, Beijing, China
Z. Yu
High-Speed Silicon-Based System-on-Chip Research Laboratory, BIT Chongqing Institute of Microelectronics and Microsystems, Chongqing, China
B. Li
CATARC, Automotive Test Center (Ningbo) Co., LTD, Ningbo, China
J. Li
Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing, China
Y. He
Test Center, DONGFENG LIUZHOU MOTOR CO., LTD, Liuzhou, China
J. Tang
Trial and Testing Division of the Research and Development Center, East Shineray Group Co., LTD, Chongqing, China

Publication Details

Type
proceedings
Publisher
IEEE
Volume
Issue
ISSN
Citations
0
Views
0