Per-track decoded audio sink (audioTrackFrames) — darwin + web #1

Merged

brenno merged 12 commits from sink/base into main

2026-10-26 19:52:40 +00:00

brenno commented

2026-10-26 19:52:31 +00:00

Owner

Adds the audioTrackFrames API used by OciDeck #2527. Upstream: flutter-webrtc/flutter-webrtc#2250.

brenno added 12 commits

2026-10-26 19:52:32 +00:00

feat: per-track decoded audio sink (darwin + web) c8c6a2e263

audioTrackFrames(track) streams s16le PCM per track: local via
AudioSourceInterface::AddSink, remote via AudioTrackInterface::AddSink,
web via MediaStreamAudioSourceNode + ScriptProcessor (zero-gain tap).
Basis for OciDeck call recording (#2527).

fix: AudioFrame.pcm typed as Uint8List 0a748a5e18

fix(darwin): macOS header + typedDataWithBytes NSData signature 7aeade606a

fix(darwin): private shims for nativeTrack + sibling symlinks 3c641bb151

refactor(darwin): RTCAudioRenderer-based tap, pure ObjC, no C++ needed b49655fd04

fix(web): scriptprocessor mono-request, toDart close, int sampleRate 09010d70fb

fix(darwin): unguard capture dispatch for macOS; cancel-safe native tap 221685d4b6

chore(darwin): tijdelijke diagnostiek voor #2527-tap 0a2f54376f

feat(darwin): local track tap via audio-source sink on macOS f4dc1af6a5

The SDK only drives RTCAudioTrack renderers from the remote decode path;
local tracks get their PCM through FlutterRTCAudioSink (capture-side
AudioSourceInterface::AddSink), enabled on macOS via the vendored C++
shims and .mm sources.

chore(darwin): local-tap diagnostics 710a844f0a

fix(darwin): tap local audio via LocalAudioTrack APM renderer 113492324c

AudioSourceInterface::AddSink never delivers OnData for local tracks in
this SDK build, so use the plugin's own LocalAudioTrack.addRenderer:
(capturePostProcessingAdapter on RTCDefaultAudioProcessingModule), which
is pure ObjC and needs no C++ shims. renderPCMBuffer: now also handles
non-interleaved int16 buffers produced by the APM adapter.

chore(darwin): drop temporary capture diagnostics

Build / WebRTC-SDK Version Consistency (pull_request) Failing after 18s

Details

Build / Build for Flutter Linux (pull_request) Failing after 19s

Details

Build / Build for Flutter Android (pull_request) Failing after 19s

Details

Build / Dart Format Check (pull_request) Failing after 20s

Details

Build / Build for Flutter Embedded Linux (pull_request) Failing after 13s

Details

Build / Build for Flutter Web (pull_request) Failing after 14s