Skip to content

feat(v2.0.1): align audio with current speech models and protocols (2.0.1) - #214

Merged
lzsweb merged 6 commits into
dev/v2from
dev/v2.0.1-audio
Oct 20, 2026
Merged

lzsweb merged 6 commits into
dev/v2from
dev/v2.0.1-audio

Conversation

@lzsweb

@lzsweb lzsweb commented Oct 20, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Audio resources aligned with current qwen-audio/cosyvoice models; audio.translation removed (use realtime sessions).
  • Examples: audio_speech/ renamed to audio/ and merged with the 12-CLI speech sample suite (+ direct_call/ variants).
  • 2.0 audio API unmarked as preview (final in 2.0.1); version bumped to 2.0.1.
  • Ride-along fixes: agentstudio proxy rewrite, SSE error parsing, ws multi-task hardening, stream close/header precedence.

Test plan

  • tests/v2: 2724 passed, 3 skipped
  • tests/unit: 1068 passed, 7 skipped
  • pre-commit on all changed files

zhansheng.lzs added 2 commits October 20, 2026 14:39
Merge the audio protocol updates and their ride-along fixes:

- rework audio resources (asr/tts/realtime/voices/voice_design/
  phrases/customization) for the current qwen-audio and cosyvoice
  model families; drop audio.translation, superseded by realtime
  sessions (realtime_translation)
- harden the shared ws transport for multi-task connections:
  cross-task event guard, reader routing/error propagation and
  lifecycle cleanup; submit explicitly empty job parameters
- agentstudio proxy rewrite: original error-code fidelity, wider
  stream-error translation, stale-cache and iterator-leak fixes
- errors/transport: multi-frame SSE error parsing, stream close on
  error, SDK auth header precedence, tool_choice=None passthrough
- examples: rename 01_atomic_capabilities/audio_speech to audio and
  merge in the speech sample suite (12 CLIs plus direct_call
  variants); drop the superseded audio_asr/audio_tts snippets
- unmark the 2.0 audio preview: the audio API is final
@lzsweb lzsweb changed the title feat(v2): align audio with current speech models and protocols (2.0.1) feat(v2.0.1): align audio with current speech models and protocols (2.0.1) Oct 20, 2026
zhansheng.lzs added 4 commits October 20, 2026 14:53
The pre-commit CI job runs hooks over all files; wider inference
context than changed-file runs surfaces three findings:

- _agentstudio: restore the _STATUS_BY_CLASS Dict[type, int]
  annotation so __mro__ indexing type-checks
- test_audio_management: pinpoint-disable unsubscriptable-object on
  the mocked Optional[Dict] preview_audio subscript
- test_chat: pinpoint-disable not-an-iterable where pylint cannot
  resolve the stream=True overload
- the Unit Tests workflow only triggered on pull requests to main, so
  PRs into dev/v2 (the v2 development line) got no CI test coverage
- add dev/v2 to the pull_request branch filter; the push trigger and
  the 3.9/3.12/3.13/3.14 matrix stay unchanged
- the fixed 0.3s sleep left the duration assertion only 0.1s of slack;
  a shared CI runner starved the daemon flusher thread for ~0.17s and
  the 3.14 UT leg failed (0.13 > first + 0.2)
- add _await_usage(): poll the usage file every 0.05s with a 5s
  deadline and use it in all three sleep-then-assert tests; the
  behavior contracts they pin are unchanged
@lzsweb
lzsweb merged commit 186b711 into dev/v2 Oct 20, 2026
2 checks passed
lzsweb pushed a commit that referenced this pull request Oct 20, 2026
- re-apply cbed9ae's preview marking, which the 2.0.1 audio alignment
  (#214) dropped: client.audio mounts lazily and emits a one-time
  FutureWarning on first access, Audio/AsyncAudio docstrings carry the
  preview note, and the examples READMEs flag the audio row
- the audio surface is still iterating, so the warning stays until it
  stabilizes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant