Noise Adaptive Streaming Audio-Visual Speech Token Enhancement for Robust Full-Duplex Spoken Dialogue Models
arXiv:2609.08390v1 Announce Type: cross Abstract: Full-duplex spoken dialogue systems enable simultaneous listening and speaking, but their audio-only perception often fails under background noise and overlapping speech, leading to incoherent responses. Recent audio-visual dialogue approaches show that incorporating vi
What's actually new here is Noise Adaptive Streaming Audio-Visual Speech Token Enhancement - see if it moves anything you maintain. For researchers and builders, this is an early signal to fold into evaluation, model choice, or agent design.