A cross-border community for researchers with openness, equality and inclusion
A Mel-Scale STFT-Domain TinyUNet for Speech Enhancement on an ESP32-S3 Microcontroller
ID:83 View protection:Participant Only Updated time:2026-10-04 23:34:43 Views:35 Online

Start Time:2026-10-13 10:30

Duration:15min

Session:[S2] Track 2: IoT and applications [S2-3] Track 2: IoT and applications

Abstract
Deploying speech enhancement directly on microcontroller units provides an energy-efficient, privacy-preserving front-end for voice-enabled edge computing. However, conventional deep neural architectures impose computational loads and memory footprints that exceed the strict resource boundaries of commodity microcontrollers. This paper introduces a Mel-scale STFT-domain TinyUNet comprising 13,651 parameters, optimized for on-device speech enhancement on an ESP32-S3 microcontroller operating at 240 MHz. Rather than processing full-resolution linear spectrograms, the architecture utilizes a 64-channel Mel filterbank representation, effectively halving the acoustic feature dimensionality while retaining the primary spectral envelope for causal mask estimation. Under full 8-bit integer (INT8) post-training quantization, the model occupies 45.57 KB of Flash memory and 18.06 KB of internal SRAM. Experimental evaluation on the DEMAND dataset across signal-to-noise ratios from -5 dB to +10 dB confirms that the quantized model achieves robust noise suppression, providing consistent improvements in objective quality and signal clarity over traditional statistical baselines with negligible performance loss relative to floating-point precision. Measured on-device execution of the complete pipeline, encompassing hardware-accelerated Fourier transforms, neural mask inference, and overlap-add synthesis, processes a 72 ms audio context window in 22.97 ms entirely within on-chip SRAM, establishing a practical baseline for deep neural speech enhancement on low-cost edge devices.
Keywords
Speech enhancement,short-time Fourier transform (STFT),Microcontroller,Unet
Speaker
Kien Trong Nguyen
Posts and Telecommunications Institute of Technology;Ho Chi Minh City

Post comments
Verification Code Change Another
All comments
Important Dates
  • Conference date

    10-11

    2026

    -

    10-14

    2026

  • 12-30 2025

    Presentation submission deadline

  • 09-28 2026

    Early Bird Registration

  • 10-14 2026

    Draft paper submission deadline

  • 10-15 2026

    Registration deadline

Sponsored By

United Societies of Science

Organized By

Posts and Telecommunications Institute of Technology

Contact info
×

USS WeChat Official Account

USSsociety

Please scan the QR code to follow
the wechat official account.