Abstract
While Self-supervised Learning (SSL) has significantly improved Spoken
Language Identification (LID), existing models often struggle to consistently
classify dialects and accents of the same language as a unified class. To
address this challenge, we propose geolocation-aware LID, a novel approach that
incorporates language-level geolocation information into the SSL-based LID
model. Specifically, we introduce geolocation prediction as an auxiliary task
and inject the predicted vectors into intermediate representations as
conditioning signals. This explicit conditioning encourages the model to learn
more unified representations for dialectal and accented variations. Experiments
across six multilingual datasets demonstrate that our approach improves
robustness to intra-language variations and unseen domains, achieving new
state-of-the-art accuracy on FLEURS (97.7%) and 9.7% relative improvement on
ML-SUPERB 2.0 dialect set.
Abstract
Indoor localization is a long-standing challenge in mobile computing, with
significant implications for enabling location-aware and intelligent
applications within smart environments such as homes, offices, and retail
spaces. As AI assistants such as Amazon Alexa and Google Nest become
increasingly pervasive, microphone-equipped devices are emerging as key
components of everyday life and home automation. This paper introduces a
passive, infrastructure-light system for localizing human speakers using speech
signals captured by two or more spatially distributed smart devices. The
proposed approach, GCC+, extends the Generalized Cross-Correlation with Phase
Transform (GCC-PHAT) method to estimate the Angle-of-Arrival (AoA) of audio
signals at each device and applies robust triangulation techniques to infer the
speaker's two-dimensional position. To further improve temporal resolution and
localization accuracy, feature-space expansion and subsample interpolation
techniques are employed for precise Time Difference of Arrival (TDoA)
estimation. The system operates without requiring hardware modifications, prior
calibration, explicit user cooperation, or knowledge of the speaker's signal
content, thereby offering a highly practical solution for real-world
deployment. Experimental evaluation in a real-world home environment yields a
median AoA estimation error of 2.2 degrees and a median localization error of
1.25 m, demonstrating the feasibility and effectiveness of audio-based
localization for enabling context-aware, privacy-preserving ambient
intelligence.