A cross-border community for researchers with openness, equality and inclusion
A Lightweight Edge-Cloud Architecture for Real-Time Vietnamese Sign Language Translation Using YOLO-Based Hand Detection on Raspberry Pi
ID:15 View protection:Participant Only Updated time:2026-10-08 17:27:50 Views:25 Poster Presentation

Start Time:2026-10-12 08:12

Duration:1min

Session:[OP] Poster [P] Poster

Abstract
Sign language serves as a primary communication medium for deaf and hard-of-hearing individuals. However, the lack of widespread sign language literacy among the general population creates significant communication barriers in public service environments such as hospitals, schools, banks, and administrative offices. This paper presents a lightweight Edge–Cloud architecture for real-time Vietnamese Sign Language (VSL) translation into Vietnamese speech using an embedded Raspberry Pi platform. The proposed system integrates a YOLO-based hand detection module, a convolutional neural network (CNN) for static hand-sign classification, cloud-assisted natural language processing for sentence reconstruction, and text-to-speech synthesis for voice generation. The work desmontrate a temporal confirmation mechanism and automatic phrases termination strategy to reduce classification noise and eliminate manual input controls, as well as contribute a curated dataset of 7070 Vietnamese hand-signalphabet gestures. Experimental results demonstrate a classification accuracy upto 98.5%, while maintaining real-time operation on a resource-constrained embedded device. The proposed system offers a complete, low-cost and deployable end-to-end embedded sign-to-speech prototype solution for assistive communication and inclusive smart services. It is especially useful and convinient for disability to communicate and express their thoughts directly with others in public services, hospitals, banks or edge for smart customer services.
Keywords
Vietnamese Sign Language, Edge AI, Computer Vision, YOLO, CNN, Raspberry Pi, Assistive Technology, Human-Centered AI
Speaker
Trung Tra Bui
Post and Telecommunications Institute Of Technology

Nhu Nguyet Tran
Posts and Telecommunications Institute of Technology

Post comments
Verification Code Change Another
All comments
Important Dates
  • Conference date

    10-11

    2026

    -

    10-14

    2026

  • 12-30 2025

    Presentation submission deadline

  • 09-28 2026

    Early Bird Registration

  • 10-14 2026

    Draft paper submission deadline

  • 10-15 2026

    Registration deadline

Sponsored By

United Societies of Science

Organized By

Posts and Telecommunications Institute of Technology

Contact info
×

USS WeChat Official Account

USSsociety

Please scan the QR code to follow
the wechat official account.