Skip to content
Drix10 Blog

E-Gaborformer – strictly causal speech recognizer with 19MB constant streaming state

, 8 items in AI Generated Music and Audio, 4 min read

In this digest (8 items)

E-Gaborformer is a strictly causal encoder that uses Gated DeltaNet-2 recurrent layers and sliding-window attention, keeping streaming memory constant at about 19MB per call. It achieves up to 31% lower English WER than NVIDIA’s Nemotron 3.5 streaming model on voice-agent traffic and trains the RNN-T lattice 2.6× faster.

Key points

  • Streaming state constant ~19MB per call; a comparable causal-attention encoder exceeds 1GB after ten minutes.

  • 0.6B-parameter Hebrew and English streaming transducer built on E-Gaborformer reduces English WER by 28-31% versus NVIDIA Nemotron 3.5 streaming.

Sources

Decode Before You Hear: Speculative Listening speeds up full-duplex speech models

Decode Before You Hear introduces Speculative Listening, a training-free framework that speeds speak chunks 2.6-2.8× and tool-call chunks up to 23.4×. It drafts the next chunk during idle time using a silence assumption and verifies drafts when audio arrives.

Key points

  • 95.3% of next audio chunks do not change the model output.

  • Decoding delay before a response starts is reduced by 73% to 74-241 ms.

Sources

SubRoformer: Subband Time-Domain code released

SubRoformer: Subband Time-Domain Representation for Music Source Separation code released, achieving 10.63 dB SDR on MUSDB18-HQ. With 500 extra songs, a single model reaches 11.59 dB SDR across four stems.

Key points

  • Average SDR 10.63 dB on MUSDB18-HQ test set using target-specific models.

  • Average SDR 11.59 dB with 500 additional training songs using a single model for all four stems.

Sources

DM-ASR – Diarization-aware Multi-speaker ASR with unified offline and online decoding

DM-ASR is a diarization-aware multi-speaker ASR framework that treats transcription as diarization-conditioned multi-turn dialogue generation. It adds optional word-level timestamps and uses Group Sequence Policy Optimization for fine-tuning, enabling both offline and causal sentence-level online decoding. Experiments on Mandarin and English benchmarks show competitive structured transcription with relatively compact models and limited training data.

Key points

  • Reformulates multi-speaker recognition as diarization-conditioned multi-turn dialogue generation.

  • Supports unified offline and online decoding through flexible acoustic context and dialogue history management.

Sources

VoxCanvas-41M dataset released with 41M speech editing pairs

VoxCanvas-41M dataset released with about 41 million bilingual speech editing pairs for instruction-based editing. It covers content editing (single-span, multi-span, location-reference) and paralinguistic editing of 39 non-verbal event classes, and enables training of the VoxCanvas-Edit model.

Key points

  • Dataset size: ~41 million bilingual speech editing pairs.

  • Editing categories: content editing (single-span, multi-span, location-reference) and paralinguistic editing (insertion/deletion of 39 nonverbal event classes).

Sources

ElevenAgents Unity SDK now available for voice interaction

ElevenAgents Unity SDK is now available, letting players walk up to a character and talk out loud. Characters can respond with any voice from the library and trigger actions via client tools.

Key points

  • Players can walk up to a character and talk out loud.

  • Characters can respond with any voice in the library and take actions using client tools.

Sources

Soniox STT v6 launches with 60+ language support and agent echo cancellation

Soniox STT v6 is a new speech-to-text model that supports over 60 languages and adds agent text input and voice echo cancellation. It claims higher accuracy for numbers, currencies, units, dates, names, alphanumeric identifiers, and specialized terminology. Developers can improve results by supplying product names, professional vocabularies, and project terminology.

Key points

  • Supports 60+ languages with faster, more accurate voice typing.

  • Introduces agent voice echo cancellation to filter out playback while still listening to the user.

Sources

InfiniStems ARA VST3/AU plugin released GPU accelerated

InfiniStems ARA VST3/AU plugin released GPU accelerated. The model is now available as an ARA VST3/AU plugin for DAWs. It runs on GPU for maximum speed.

Key points

  • Plugin type: ARA VST3/AU plugin

  • Acceleration: GPU accelerated for maximum speed

Sources