Apple researchers distill streaming neural audio encoders for on-device dictation

Apple ML researchers study compression of streaming neural audio encoders via latent-space distillation for the always-on dictation tokenizer in System-wide Dictation. The work addresses power and latency trade-offs under sparse model activation.