# Release notes (/en/realtime-media/voice/reference/release-notes/electron)
> For AI agents: see the complete documentation index at [llms.txt](/llms.txt).
### Known issues [#known-issues-6]
The list of known issues page is continuously updated as the systems evolve. Agora suggests you regularly upgrade to the latest version of the SDK, which includes new features, bug fixes and improvements.
* Electron SDK v4.4.0
**MacOS 15 Sequoia beta system issue**
When the app path (including the App name) contains non-English characters (such as Chinese characters), the compiled `Metal shader library` may not contain any methods, causing the app to crash. See [this article](/en/api-reference/faq/other/macos_15_beta) for the workaround.
### v4.6.2 [#v462-5]
Released on March 14, 2026.
#### Compatibility changes [#compatibility-changes-49]
This release introduces the following compatibility changes:
* **Deprecation of Direct CDN streaming APIs**
The following APIs related to Direct CDN streaming are deprecated in this release and will be removed in a future version. Use [server-side transcoding and media push](/en/realtime-media/media-push/get-started/enable-media-push) instead.
* `setDirectCdnStreamingAudioConfiguration`
* `setDirectCdnStreamingVideoConfiguration`
* `startDirectCdnStreaming`
* `stopDirectCdnStreaming`
* `DirectCdnStreamingMediaOptions`
* `DirectCdnStreamingStats`
* `DirectCdnStreamingState`
* `DirectCdnStreamingReason`
* **Deprecation of virtual metronome APIs**
The following APIs related to the virtual metronome feature are deprecated in this release and will be removed in a future version.
* `startRhythmPlayer`
* `configRhythmPlayer`
* `onRhythmPlayerStateChanged`
* **Removal of redundant APIs**
The following APIs and parameters are removed in this release:
* `setLocalPublishFallbackOption`
* `onLocalPublishFallbackToAudioOnly`
* `onDownlinkNetworkInfoUpdated`
* `onWlAccStats`
* `enableWirelessAccelerate`
* **New domains required for domain whitelist**
If you upgrade from a previous version and use the domain whitelist feature (`domainLimit` in `RtcEngineConfig` set to `true`), add the following domains to ensure uninterrupted communication:
* `*.rtnsvc.com`
* `*.realtimemesh.com`
#### New features [#new-features-83]
Included in this release:
* **Multi-path network transmission**
This release introduces multi-path transmission for devices that support multiple network interfaces (such as 5G, Wi-Fi, and LAN). This feature reduces or eliminates experience degradation caused by poor network conditions, making it suitable for real-time audio and video communication in challenging environments such as vehicles, IoT devices, trains, and highways.
Enable multi-path transmission by setting `enableMultipath` to `true` in `ChannelMediaOptions`. Two transmission modes are supported through `MultipathMode`:
* **Dynamic mode** (default): Dynamically selects the best available path based on network conditions. Suited for traffic-sensitive scenarios with high experience requirements, such as meetings and online education. In this mode, you can specify the preferred network path (for example, Wi-Fi or mobile network) using `preferMultipathType`.
* **Full redundancy mode**: Transmits data simultaneously on all available network paths. Suited for scenarios that are not traffic-sensitive but require extreme reliability, such as outdoor broadcasting and parallel control. This mode incurs additional costs. [Contact technical support](mailto\:support@agora.io) to enable it.
Uplink and downlink paths can also be configured separately using `uplinkMultipathMode` and `downlinkMultipathMode` in `ChannelMediaOptions`. Once enabled, the SDK reports real-time transmission statistics for each path through the `onMultipathStats` callback, including per-path traffic consumption.
* **Token renewal result callback**
This release introduces the `onRenewTokenResult` callback and the `RenewTokenErrorCode` error code enum. After calling `renewToken` to update the token, the SDK reports the result through `onRenewTokenResult` and returns detailed error codes defined in `RenewTokenErrorCode`, allowing you to handle token renewal failure scenarios accordingly.
* **Media Player support for getting audio buffer delay**
To address synchronization issues between the main vocal and background accompaniment in karaoke scenarios, this release adds the `getAudioBufferDelay` method to the Media Player module. This method returns the millisecond-level audio buffer delay when playing media files.
* **Other new features**
* Adds the `setPlaybackAudioFrameBeforeMixingParameters` method to set the audio frame format returned in the `onPlaybackAudioFrameBeforeMixing` callback, including sample rate, number of channels, and number of data samples per callback. After calling this method, the SDK returns the original pre-mix audio data according to the specified parameters.
* Adds the `preloadEffectEx` method to preload sound effect files into specified channels, supporting both local and online files for use in multi-channel scenarios.
* Adds the `playEffectEx` method to play sound effect files in specified channels with configurable parameters, including loop count, pitch, spatial position, volume, whether to publish to the channel, and playback start position.
#### Improvements [#improvements-89]
This release includes the following enhancements:
* **Seamless switching for sound effect files**
Adds support for seamless switching of sound effect files. For the same sound effect file, if you call `preloadEffect` followed by `playEffect`, the SDK does not close the file after playback completes or when `stopEffect` is called. When you call `playEffect` again, the SDK reuses the loaded file to enable loop playback and seamless switching. This feature also works in multi-channel scenarios.
* **Improved accuracy of network quality evaluation**
Improves the accuracy of network quality evaluation in the `onNetworkQuality` callback, making the reported data better reflect the user's perceived experience.
* **Support for 24kHz sampling rate for audio playback**
Adds support for audio data with a sample rate of 24000 Hz in `onPlaybackAudioFrame`. When calling `setPlaybackAudioFrameParameters` to set the playback audio format, you can set `sampleRate` to `24000`.
* **Additional improvements**
* Optimizes permission requests on Windows 11 24H2 and later to avoid unnecessary location data acquisition.
* Adds support for G.711 and G.722 audio codecs when interoperating with Web clients, improving cross-platform audio compatibility and clarity.
* Adds error codes `ERR_PCMSEND_FORMAT (200)` and `ERR_PCMSEND_BUFFEROVERFLOW (201)` to report PCM data transmission errors.
#### Issues fixed [#issues-fixed-82]
This release fixes the following issues:
* When playing multi-track songs with guide vocal enabled, noise occurred after calling `setAudioPitch` to adjust the pitch.
* When a broadcaster created a custom audio capture track using `createCustomAudioTrack` with `trackType` set to `AudioTrackDirect`, pushed self-captured audio using `pushAudioFrame`, and then played sound effects using `playEffect`, the audience in the channel heard noise in the broadcaster's audio.
* Apps integrated with the SDK occasionally experienced UI freezing due to main thread blocking during audio and video engagements.
* Receivers occasionally heard noise when the sender transmitted multi-channel encoded audio.
* When calling `open` twice to open different media resources, the `onPlayerInfoUpdated` callback returned information about the first resource when opening the second, which was incorrect.
* When calling `enableAudioVolumeIndication` to enable volume indication for local streaming users and remote users, the local user volume returned by `onAudioVolumeIndication` was 0.
* After calling `open` to open an online sound effect file and `playEffect` to start playback, calling `seek` to set the playback position caused the file to play from the beginning instead of the specified position.
* In media volume mode, when a broadcaster published microphone audio while simultaneously playing sound effects with `playEffect` and a music file with `startAudioMixing`, echo occasionally occurred.
* After calling `joinChannelEx` to join a channel and `startOrUpdateChannelMediaRelay` to start cross-channel media relay, rejoining the channel after going offline and leaving occasionally caused `onChannelMediaRelayStateChanged` to report `state` as `RelayStateFailure` with `code` as `RelayErrorServerErrorResponse`.
* On some laptop models with power-saving mode enabled, receivers occasionally heard echo when the sender shared screen and audio.
### v4.5.1 [#v451-4]
v4.5.1 was released on March 13, 2025.
#### New features [#new-features-84]
1. **AI conversation scenario**
This version adds the `AudioScenarioAiClient` audio scenario specifically designed for interacting with the conversational AI agent created by [Conversational AI Engine](/en/ai). This scenario optimizes the audio transmission algorithm based on AI-generated voice characteristics, ensuring stable voice data transmission even in weak network conditions with up to 80% packet loss. It enhances conversation continuity and reliability while adapting to complex network conditions.
#### Issues fixed [#issues-fixed-83]
This release fixes the following issues:
* When joining two or more channels simultaneously, and calling the `takeSnapshotEx` method to take screenshots of the local video streams in each channel consecutively, the screenshot of the first channel failed.
* When using the `pause` method to pause playback, then calling `seek` to move to a specified position, and finally calling `play` to continue playback, the Media Player resumed from the position where it was paused, not the new specified position.
* When using the Media Player, the file path of the media resource returned by the `getPlaySrc` did not change after calling the `switchSrc` method to switch to a new media resource.
* In the interactive live streaming scenario, after joining a channel to watch live streams using `string` user id, the audience members occasionally saw that the audio was not synchronized with the video.
* Plugins sometimes did not work when using AI noise suppression and AI echo cancellation plugins at the same time.
### v4.5.0 [#v450-5]
v4.5.0 was released on December 10, 2024.
#### Compatibility changes [#compatibility-changes-50]
This version includes optimizations to some features, including changes to SDK behavior and API renaming and deletion. To ensure normal operation of the project, update the code in the app after upgrading to this release.
1. **Changes in strong video noise suppression implementation**
This version adjusts the implementation of strong video noise suppression.
`VideoDenoiserLevelStrength` is removed from `VideoDenoiserLevel`.
Instead, after enabling video noise suppression by calling `setVideoDenoiserOptions`, you can call the `setBeautyEffectOptions` method to enable the beauty skin smoothing feature. Using both together will help achieve better video noise suppression effects. For strong noise suppression, it is recommended to set the skin smoothing parameters as detailed in `setVideoDenoiserOptions`.
Additionally, due to this adjustment, to achieve the best low-light enhancement effect with a focus on image quality, enable video noise suppression first and use specific settings as detailed in `setLowlightEnhanceOptions`.
2. **Changes in camera plug and unplug status**
In previous versions, when the camera was unplugged and replugged, the `onVideoDeviceStateChanged` callback would report the device status as `MediaDeviceStateActive` (1) (device in use). Starting from this version, after the camera is replugged, the device status will change to `MediaDeviceStateIdle`(0) (device ready).
3. **Changes in video encoding preferences**
To enhance the user’s video interaction experience, this version optimizes the default preferences for video encoding:
* In the [`CompressionPreference`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_compressionpreference.html) enumeration class, a new `PreferCompressionAuto` (-1) enumeration is added, replacing the original `PreferQuality` (1) as the default value. In this mode, the SDK will automatically choose between `PreferLowLatency` and `PreferQuality` based on your video scene settings to achieve the best user experience.
* In the [`DegradationPreference`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_degradationpreference.html) enumeration class, a new `MaintainAuto` (-1) enumeration is added, replacing the original `MaintainQuality` (1) as the default value. In this mode, the SDK will automatically choose between `MaintainFramerate`, `MaintainBalanced`, and `MaintainResolution` based on your video scene settings to achieve the optimal overall quality of experience (QoE).
#### New features [#new-features-85]
1. **Live show scenario**
This version adds the `ApplicationScenarioLiveshow`(3) (Live Show) enumeration to [`VideoApplicationScenarioType`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_videoapplicationscenariotype.html). You can call `setVideoScenario` to set the video business scenario to show room. In this scenario, fast video rendering and high image quality are crucial. The SDK implements several performance optimizations, such as enabling accelerated audio and video frame rendering to minimize first-frame latency (no need to call `enableInstantMediaRendering`) to achieve better image quality and bandwidth efficiency.
2. **Maximum frame rate for video rendering**
This version adds the [`setLocalRenderTargetFps`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setlocalrendertargetfps) and [`setRemoteRenderTargetFps`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setremoterendertargetfps) methods, which support setting the maximum frame rate for video rendering locally and remotely. The actual frame rate for video rendering by the SDK will be as close to this value as possible.
In use-cases where the frame rate requirement for video rendering is not high (for example, screen sharing, online education) or when the remote end uses mid-to-low-end devices, you can use this set of methods to limit the video rendering frame rate, thereby reducing CPU consumption and improving system performance.
3. **Filter effects**
This version introduces the [`setFilterEffectOptions`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setfiltereffectoptions) method. You can pass a cube map file (`.cube`) in the `config` parameter to achieve custom filter effects such as whitening, vivid, cool, black and white, etc. Additionally, the SDK provides a built-in `built_in_whiten_filter.cube` file for quickly achieving a whitening filter effect.
4. **Local audio mixing**
This version introduces the local audio mixing feature. You can call the [`startLocalAudioMixer`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_startlocalaudiomixer) method to mix the audio streams from the local microphone, media player, sound card, and remote audio streams into a single audio stream, which can then be published to the channel. When you no longer need audio mixing, you can call the `stopLocalAudioMixer` method to stop local audio mixing. During the mixing process, you can call the `updateLocalAudioMixerConfiguration` method to update the configuration of the audio streams being mixed.
Example use cases for this feature include:
* By utilizing the local video mixing feature, the associated audio streams of the mixed video streams can be simultaneously captured and published.
* In live streaming use-cases, users can receive audio streams within the channel, mix multiple audio streams locally, and then forward the mixed audio stream to other channels.
* In educational use-cases, teachers can mix the audio from interactions with students locally and then forward the mixed audio stream to other channels.
5. **Color space settings**
This version adds the `colorSpace` parameter to `VideoFrame` and `ExternalVideoFrame`. You can use this parameter to set the color space properties of the video frame. By default, the color space uses Full Range and BT.709 standard configuration. You can flexibly adjust according to your own capture or rendering needs, further enhancing the customization capabilities of video processing.
6. **Others**
* [`onLocalVideoStateChanged`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengineeventhandler.html#callback_irtcengineeventhandler_onlocalvideostatechanged) callback adds the `LocalVideoStreamReasonDeviceDisconnected` enumeration, indicating that the currently used video capture device has been disconnected (e.g., unplugged). (Windows)
* [`MediaDeviceStateType`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_mediadevicestatetype.html) adds the `MediaDeviceStatePluggedIn` enumeration, indicating that the device has been plugged in. (Windows)
#### Improvements [#improvements-90]
1. **Virtual background algorithm optimization**
This version upgrades the virtual background algorithm, making the segmentation between the portrait and the background more accurate. There is no background exposure, the body contour of the portrait is complete, and the detail recognition of fingers is significantly improved. Additionally, the edges between the portrait and the background are more stable, reducing edge jumping and flickering in continuous video frames.
2. **Snapshot at specified video observation points**
This version introduces the [`takeSnapshotWithConfig`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_takesnapshot2) and [`takeSnapshotWithConfigEx`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengineex.html#api_irtcengineex_takesnapshotex2) methods. You can use the `config` parameter when calling these methods to take snapshots at specified video observation points, such as before encoding, after encoding, or before rendering, to achieve more flexible snapshot effects.
3. **Custom audio capture improvements**
This version adds the `enableAudioProcessing` member parameter to [`AudioTrackConfig`](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_audiotrackconfig.html), which is used to control whether to enable 3A audio processing for custom audio capture tracks of the `AUDIO_TRACK_DIRECT` type. The default value of this parameter is `false`, meaning that audio processing is not enabled. Users can enable it as needed, enhancing the flexibility of custom audio processing.
4. **Other improvements**
* Optimizes the logic for calling `queryDeviceScore` to obtain device score levels, improving the accuracy of the score results.
* Supports using virtual cameras in YV12 format as video capture devices. (Windows)
* When calling `switchSrc` to switch between live streams or on-demand streams of different resolutions, smooth and seamless switching can be achieved. An automatic retry mechanism has been added in case of switching failures. The SDK will automatically retry 3 times after a failure. If it still fails, the `onPlayerEvent` callback will report the `PlayerEventSwitchError` event, indicating an error occurred during media resource switching.
* When calling `setPlaybackSpeed` to set the playback speed of an audio file, the minimum supported speed is 0.3x.
#### Issues fixed [#issues-fixed-84]
This version fixes the following issues:
* When calling `startScreenCaptureByWindowId` to share the screen, the window capture area specified by `regionRect` was inaccurate, resulting in incorrect width and height of the screen sharing window seen by the receiving end. (Windows)
* Occasional errors of not finding system files during audio and video interaction on Windows 7 systems. (Windows)
* When calling `followSystemRecordingDevice` or `followSystemPlaybackDevice` to set the audio capture or playback device used by the SDK to not follow the default system audio playback device, the local audio state callback `onLocalAudioStateChanged` is not triggered when the audio device is removed, which is not as expected. (Windows)
### v4.4.0 [#v440-5]
v4.4.0 was released on August 29, 2024.
#### Compatibility changes [#compatibility-changes-51]
This version includes optimizations to some features, including changes to SDK behavior and API renaming and deletion.
To ensure normal operation of the project, update the code in the app after upgrading to this release.
1. To distinguish context information in different extension callbacks, this version removes the original extension callbacks and adds corresponding callbacks that contain context information (see the table below). You can identify the extension name, the user ID, and the service provider name through `ExtensionContext` in each callback.
| Original callback | New callback |
| -------------------- | ------------------------------- |
| `onExtensionEvent` | `onExtensionEventWithContext` |
| `onExtensionStarted` | `onExtensionStartedWithContext` |
| `onExtensionStopped` | `onExtensionStoppedWithContext` |
| `onExtensionError` | `onExtensionErrorWithContext` |
2. This version renames the following members in `ExternalVideoFrame`:
* `d3d11_texture_2d` is renamed to `d3d11Texture2d`.
* `texture_slice_index` is renamed to `textureSliceIndex`.
* `metadata_buffer` is renamed to `metadataBuffer`.
* `metadata_size` is renamed to `metadataSize`.
#### New features [#new-features-86]
1. **Voice AI tuner**
This version introduces the voice AI tuner feature, which can enhance the sound quality and tone, similar to a physical sound card. You can enable the voice AI tuner feature by calling the `enableVoiceAITuner` method. Pass in the sound effect types supported in the `VoiceAiTunerType` enum to achieve the effects such as a deep voice, cute voice, husky singing voice, and others.
#### Improvements [#improvements-91]
1. **Adaptive hardware decoding support (Windows)**
This release introduces adaptive hardware decoding support, enhancing rendering smoothness on low-end devices and effectively reducing the system load.
2. **Other improvements**
This version also includes the following improvements:
* Optimizes the transmission strategy: Calling `enableInstantMediaRendering` no longer impacts the security of the transmission link.
* Adds the `channelId` parameter to `Metadata`, which is used to get the channel name from which the metadata is sent.
* Deprecates redundant enumeration values `ClientRoleChangeFailedRequestTimeOut` and `ClientRoleChangeFailedConnectionFailed` in `ClientRoleChangeFailedReason`.
#### Issues fixed [#issues-fixed-85]
This release fixes the issue where the app crashed during audio and video interactions after the user actively denied the permission to use audio and video devices (macOS).
### v4.3.2 [#v432-4]
v4.3.2 was released on June 6, 2024.
#### Improvements [#improvements-92]
This release enhances the usability of the [setRemoteSubscribeFallbackOption](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setremotesubscribefallbackoption) method by removing the timing requirements for invocation. It can now be called both before and after joining the channel to dynamically switch audio and video stream fallback options in weak network conditions.
#### Issues fixed [#issues-fixed-86]
This version fixed the following issue:
* The app occasionally crashed when remote users left the channel.
* Calling `leaveChannelEx` without passing in the `options` parameter occasionally led to app crashes.
### v4.3.1 [#v431-4]
v4.3.1 was released on May 9, 2024.
#### New features [#new-features-87]
1. **Data stream encryption**
This version adds `datastreamEncryptionEnabled` to [EncryptionConfig](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_encryptionconfig.html) for enabling data stream encryption. You can set this when you activate encryption with [enableEncryption](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_enableencryption). If there are issues causing failure in data stream encryption or decryption, these can be identified by the newly added `EncryptionErrorDatastreamDecryptionFailure` and `EncryptionErrorDatastreamEncryptionFailure` enumerations.
2. **Other features**
* A new method [enableEncryptionEx](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengineex.html#api_irtcengineex_enableencryptionex) is added for enabling media stream or data stream encryption in multi-channel use-cases.
* A new method [setAudioMixingPlaybackSpeed](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setaudiomixingplaybackspeed) is introduced for setting the playback speed of audio files.
* A new method [getCallIdEx](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengineex.html#api_irtcengineex_getcallidex) is introduced for retrieving call IDs in multi-channel use-cases.
#### Improvements [#improvements-93]
1. **Audio device type detection (macOS)**
This version adds the `deviceTypeName` in [AudioDeviceInfo](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_audiodeviceinfo.html), used to identify the type of audio devices, such as built-in, USB, HDMI, and so on.
2. **CPU consumption reduction of in-ear monitoring**
This release adds an enumerator `EarMonitoringFilterReusePostProcessingFilter` in `EarMonitoringFilterType`. For complex audio processing use-cases, you can specify this option to reuse the audio filter after sender-side processing in in-ear monitoring, thereby reducing CPU consumption. Note that this option may increase the latency of in-ear monitoring, which is suitable for latency-tolerant use-cases requiring low CPU consumption.
3. **Other improvements**
This version also includes the following improvements:
* In [AudioEffectPreset](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_audioeffectpreset.html), a new enumeration `RoomAcousticsChorus` (chorus effect) is added, enhancing the spatial presence of vocals in chorus use-cases.
* In [RemoteAudioStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_remoteaudiostats.html), a new `e2eDelay` field is added to report the delay from when the audio is captured on the sending side to when the audio is played on the receiving side.
#### Issues fixed [#issues-fixed-87]
This version fixed the following issues:
* In audio-video interactions, if a user inserted headphones into the device and manually switched the system audio output to speakers, and later the app called [setPlaybackDevice](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_iaudiodevicemanager.html#api_iaudiodevicemanager_setplaybackdevice) to specify the headphone as the audio playback device, audio output did not switch back to speakers as expected after the headphones were removed (macOS).
* During interactions, when a local user set the system default playback device to speakers, there was no sound from the remote end (Windows).
#### API changes [#api-changes-54]
**Added**
* [enableCameraCenterStage](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_enablecameracenterstage) (macOS)
* [isCameraCenterStageSupported](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_iscameracenterstagesupported) (macOS)
* [registerFaceInfoObserver](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaengine.html#api_imediaengine_registerfaceinfoobserver)
* [unregisterFaceInfoObserver](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaengine.html#api_imediaengine_unregisterfaceinfoobserver)
* [IFaceInfoObserver](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_ifaceinfoobserver.html#class_ifaceinfoobserver)
* [onFaceInfo](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_ifaceinfoobserver.html#callback_ifaceinfoobserver_onfaceinfo)
* [MediaSourceType](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_mediasourcetype.html) adds `SpeechDrivenVideoSource`
* [VideoSourceType](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_videosourcetype.html) adds `VideoSourceSpeechDriven`
* [EncryptionConfig](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_encryptionconfig.html) adds `datastreamEncryptionEnabled`
* [EncryptionErrorType](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_encryptionerrortype.html) adds the following enumerations:
* `EncryptionErrorDatastreamDecryptionFailure`
* `EncryptionErrorDatastreamEncryptionFailure`
* [AudioDeviceInfo](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_audiodeviceinfo.html) adds `deviceTypeName` (macOS)
* [RemoteAudioStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_remoteaudiostats.html) adds `e2eDelay`
* [ErrorCodeType](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_errorcodetype.html) adds `ErrDatastreamDecryptionFailed`
* [AudioEffectPreset](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_audioeffectpreset.html) adds `RoomAcousticsChorus`, enhancing the spatial presence of vocals in chorus use-cases.
* [getCallIdEx](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengineex.html#api_irtcengineex_getcallidex)
* [enableEncryptionEx](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengineex.html#api_irtcengineex_enableencryptionex)
* [setAudioMixingPlaybackSpeed](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setaudiomixingplaybackspeed)
* [EarMonitoringFilterType](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_earmonitoringfiltertype.html) adds a new enumeration `EarMonitoringFilterBuiltInAudioFilters`
### v4.3.0 [#v430-5]
v4.3.0 was released on February 28, 2024.
#### Compatibility changes [#compatibility-changes-52]
This release has optimized the implementation of some functions, involving renaming or deletion of some APIs. To ensure the normal operation of the project, update the code in the app after upgrading to this release.
1. **Renaming parameters in callbacks**
In order to make the parameters in some callbacks and the naming of enumerations in enumeration classes easier to understand, the following modifications have been made in this release. Modify the parameter settings in the callbacks after upgrading to this release.
| Callback | Original parameter name | New parameter name |
| ---------------------------------- | ----------------------- | ------------------ |
| `onLocalAudioStateChanged` | `error` | `reason` |
| `onLocalVideoStateChanged` | `error` | `reason` |
| `onDirectCdnStreamingStateChanged` | `error` | `reason` |
| `onRtmpStreamingStateChanged` | `errCode` | `reason` |
| Original enumeration class | New enumeration class |
| ---------------------------- | -------------------------- |
| `LocalAudioStreamError` | `LocalAudioStreamReason` |
| `LocalVideoStreamError` | `LocalVideoStreamReason` |
| `DirectCdnStreamingError` | `DirectCdnStreamingReason` |
| `MediaPlayerError` | `MediaPlayerReason` |
| `RtmpStreamPublishErrorType` | `RtmpStreamPublishReason` |
**Note:** For specific renaming of enumerations, please refer to [API changes](#api-changes).
2. **Channel media relay**
To improve interface usability, this release removes some methods and callbacks for channel media relay. Use the alternative options listed in the table below:
| Deleted methods and callbacks | Alternative methods and callbacks |
| ------------------------------------------------------ | ---------------------------------- |
| `startChannelMediaRelay`,`updateChannelMediaRelay` | `startOrUpdateChannelMediaRelay` |
| `startChannelMediaRelayEx`,`updateChannelMediaRelayEx` | `startOrUpdateChannelMediaRelayEx` |
| `onChannelMediaRelayEvent` | `onChannelMediaRelayStateChanged` |
3. **Log encryption behavior changes**
For security and performance reasons, as of this release, the SDK encrypts logs and no longer supports printing plaintext logs via the console.
Refer to the following solutions for different needs:
* If you need to know the API call status, please check the API logs and print the SDK callback logs yourself.
* For any other special requirements, please contact [technical support](mailto\:support@agora.io) and provide the corresponding encrypted logs.
4. **Audio loopback capturing**
* Before v4.3.0, if you call the [disableAudio](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_disableaudio) method to disable the audio module, audio loopback capturing will not be disabled.
* As of v4.3.0, if you call the [disableAudio](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_disableaudio) method to disable the audio module, audio loopback capturing will be disabled as well. If you need to enable audio loopback capturing, you need to enable the audio module by calling the [enableAudio](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_enableaudio) method and then call [enableLoopbackRecording](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_enableloopbackrecording).
#### New features [#new-features-88]
1. **Query Device Score**
This release adds the [queryDeviceScore](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_querydevicescore) method to query the device's score level to ensure that the user-set parameters do not exceed the device's capabilities. For example, in HD or UHD video use-cases, you can first call this method to query the device's score. If the returned score is low (for example, below 60), you need to lower the video resolution to avoid affecting the video experience. The minimum device score required for different business use-cases is varied. For specific score recommendations, please contact [technical support](mailto\:support@agora.io).
2. **Select different audio tracks for local playback and streaming**
This release introduces the [selectMultiAudioTrack](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_Imediaplayer_selectmultiaudiotrack) method that allows you to select different audio tracks for local playback and streaming to remote users. For example, in use-cases like online karaoke, the host can choose to play the original sound locally and publish the accompaniment in the channel. Before using this function, you need to open the media file through the [openWithMediaSource](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayer.html#api_imediaplayer_openwithmediasource) method and enable this function by setting the `enableMultiAudioTrack` parameter in [MediaSource](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_mediasource.html).
3. **Others**
This release has passed the test verification of the following APIs and can be applied to the entire series of RTC 4.x SDK.
* [setPlaybackDeviceVolume](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_iaudiodevicemanager.html#api_iaudiodevicemanager_setplaybackdevicevolume): Sets the volume of the audio playback device.
* [getRecordingDeviceVolume](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_iaudiodevicemanager.html#api_iaudiodevicemanager_getrecordingdevicevolume): Sets the volume of the audio capturing device.
* [setPlayerOptionInInt](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayer.html#api_imediaplayer_setplayeroption) and [setPlayerOptionInString](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayer.html#api_imediaplayer_setplayeroption2): Sets media player options for providing technical previews or special customization features.
* [enableCustomAudioLocalPlayback](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_enablecustomaudiolocalplayback): Sets whether to enable the local playback of external audio source.
#### Improvements [#improvements-94]
1. **SDK task processing scheduling optimization**
This release optimizes the scheduling mechanism for internal tasks within the SDK, with improvements in the following aspects:
* The speed of video rendering and audio playback for both remote and local first frames improves by 10% to 20%.
* The API call duration and response time are reduced by 5% to 50%.
* The SDK's parallel processing capability significantly improves, delivering higher video quality (720P, 24 fps) even on lower-end devices. Additionally, image processing remains more stable in use-cases involving high resolutions and frame rates.
* The stability of the SDK is further enhanced, leading to a noticeable decrease in the crash rate across various specific use-cases.
2. **In-ear monitoring volume boost**
This release provides users with more flexible in-ear monitoring audio adjustment options, supporting the ability to set the in-ear monitoring volume to four times the original volume by calling [setInEarMonitoringVolume](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_setinearmonitoringvolume).
3. **Spatial audio effects usability improvement**
* This release optimizes the design of the [setZones](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_ibasespatialaudioengine.html#api_ibasespatialaudioengine_setzones) method, supporting the ability to set the `zones` parameter to `NULL`, indicating the clearing of all echo cancellation zones.
* As of this release, it is no longer necessary to unsubscribe from the audio streams of all remote users within the channel before calling the [ILocalSpatialAudioEngine](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_ilocalspatialaudioengine.html#class_ilocalspatialaudioengine) method.
4. **Other Improvements**
This release also includes the following improvements:
* This release optimizes the SDK's domain name resolution strategy, improving the stability of calling to resolve domain names in complex network environments.
* This release adds the `earMonitorDelay` and `aecEstimatedDelay` members in [LocalAudioStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_localaudiostats.html) to report ear monitor delay and acoustic echo cancellation (AEC) delay, respectively.
* The [onPlayerCacheStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayersourceobserver.html#callback_imediaplayersourceobserver_onplayercachestats) callback is added to report the statistics of the media file being cached. This callback is triggered once per second after file caching is started.
* The [onPlayerPlaybackStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayersourceobserver.html#callback_imediaplayersourceobserver_onplayerplaybackstats) callback is added to report the statistics of the media file being played. This callback is triggered once per second after the media file starts playing. You can obtain information like the audio and video bitrate of the media file through [PlayerPlaybackStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_playerplaybackstats.html).
#### Issues fixed [#issues-fixed-88]
This release fixed the following issue:
* The SDK failed to detect any changes in the audio routing after plugging in and out 3.5 mm earphones.
#### API changes [#api-changes-55]
**Added**
* [enableCustomAudioLocalPlayback](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_enablecustomaudiolocalplayback)
* [queryDeviceScore](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_irtcengine_querydevicescore)
* The `CustomVideoSource` enumeration in [MediaSourceType](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_mediasourcetype.html)
* The `RouteBluetoothDeviceA2DP` enumeration in [AudioRoute](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/enum_audioroute.html)
* [selectMultiAudioTrack](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_irtcengine.html#api_Imediaplayer_selectmultiaudiotrack)
* [onPlayerCacheStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayersourceobserver.html#callback_imediaplayersourceobserver_onplayercachestats)
* [onPlayerPlaybackStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_imediaplayersourceobserver.html#callback_imediaplayersourceobserver_onplayerplaybackstats)
* [PlayerPlaybackStats](https://api-ref.agora.io/en/voice-sdk/electron/4.x/API/class_playerplaybackstats.html)
**Modified**
* All `ERROR` fields in the following enumerations are changed to `REASON`:
* `LocalAudioStreamErrorOk`
* `LocalAudioStreamErrorFailure`
* `LocalAudioStreamErrorDeviceNoPermission`
* `LocalAudioStreamErrorDeviceBusy`
* `LocalAudioStreamErrorRecordFailure`
* `LocalAudioStreamErrorEncodeFailure`
* `LocalAudioStreamErrorRecordInvalidId` (Windows)
* `LocalAudioStreamErrorPlayoutInvalidId` (Windows)
* `LocalVideoStreamErrorOk`
* `LocalVideoStreamErrorFailure`
* `LocalVideoStreamErrorDeviceNoPermission`
* `LocalVideoStreamErrorDeviceBusy`
* `LocalVideoStreamErrorCaptureFailure`
* `LocalVideoStreamErrorCodecNotSupport`
* `LocalVideoStreamErrorDeviceNotFound`
* `LocalVideoStreamErrorDeviceDisconnected`
* `LocalVideoStreamErrorDeviceInvalidId`
* `LocalVideoStreamErrorScreenCaptureWindowMinimized`
* `LocalVideoStreamErrorScreenCaptureWindowClosed`
* `LocalVideoStreamErrorScreenCaptureWindowOccluded`
* `DirectCdnStreamingErrorOk`
* `DirectCdnStreamingErrorFailed`
* `DirectCdnStreamingErrorAudioPublication`
* `DirectCdnStreamingErrorVideoPublication`
* `DirectCdnStreamingErrorNetConnect`
* `DirectCdnStreamingErrorBadName`
* `PlayerErrorNone`
* `PlayerErrorInvalidArguments`
* `PlayerErrorInternal`
* `PlayerErrorNoResource`
* `PlayerErrorInvalidMediaSource`
* `PlayerErrorUnknownStreamType`
* `PlayerErrorObjNotInitialized`
* `PlayerErrorCodecNotSupported`
* `PlayerErrorVideoRenderFailed`
* `PlayerErrorInvalidState`
* `PlayerErrorUrlNotFound`
* `PlayerErrorInvalidConnectionState`
* `PlayerErrorSrcBufferUnderflow`
* `PlayerErrorInterrupted`
* `PlayerErrorNotSupported`
* `PlayerErrorTokenExpired`
* `PlayerErrorUnknown`
* `RtmpStreamPublishErrorOk`
* `RtmpStreamPublishErrorInvalidArgument`
* `RtmpStreamPublishErrorEncryptedStreamNotAllowed`
* `RtmpStreamPublishErrorConnectionTimeout`
* `RtmpStreamPublishErrorInternalServerError`
* `RtmpStreamPublishErrorRtmpServerError`
* `RtmpStreamPublishErrorTooOften`
* `RtmpStreamPublishErrorReachLimit`
* `RtmpStreamPublishErrorNotAuthorized`
* `RtmpStreamPublishErrorStreamNotFound`
* `RtmpStreamPublishErrorFormatNotSupported`
* `RtmpStreamPublishErrorNotBroadcaster`
* `RtmpStreamPublishErrorTranscodingNoMixStream`
* `RtmpStreamPublishErrorNetDown`
* `RtmpStreamPublishErrorInvalidPrivilege`
* `RtmpStreamUnpublishErrorOk`
**Deleted**
* `startChannelMediaRelay`
* `updateChannelMediaRelay`
* `startChannelMediaRelayEx`
* `updateChannelMediaRelayEx`
* `onChannelMediaRelayEvent`
* `ChannelMediaRelayEvent`
### v4.2.6 [#v426-4]
v4.2.6 was released on November 24, 2023.
#### Issues fixed [#issues-fixed-89]
This version fixed the issue of stuttering or frozen video on the receiving end in specific use-cases, such as when the network packet loss rate was high, or when the broadcaster left the channel without destroying the engine and then re-joined the channel.
### v4.2.4 [#v424]
v4.2.4 was released on October 25, 2023.
#### Issues fixed [#issues-fixed-90]
This release fixes the following issue:
The `AgoraRtcWrapper` version number in `CFBundleShortVersionString` on macOS is wrong, which interferes with submitting the App to the App Store.
### v4.2.3 [#v423-4]
v4.2.3 was released on October 20, 2023.
#### Improvements [#improvements-95]
This release includes the following additional improvements:
* Optimizes the logic of handling invalid parameters. When you call the `setPlaybackSpeed` method to set the playback speed of audio files, if you pass an invalid parameter, the SDK returns the error code `-2`, which means that you need to reset the parameter.
* Optimizes the logic of Token parsing, in order to prevent an app from crashing when an invalid token is passed in.
#### Issues fixed [#issues-fixed-91]
This release fixed the following issues:
* Occasional crashes when joining a channel on macOS.
* When calling the `playEffect` method to play two audio files using the same `soundId`, the first audio file was sometimes played repeatedly.
#### API changes [#api-changes-56]
**Added**
* `enableContentInspectEx`
* `contentInspectImageModeration` in `ContentInspectType`
* `serverConfig` in `ContentInspectConfig`
* The following enumerations in `onLocalVideoStateChanged`:
* `LocalVideoStreamErrorScreenCapturePaused`
* `LocalVideoStreamErrorScreenCaptureResumed`
* `LocalVideoStreamErrorScreenCaptureWindowHidden`
* `LocalVideoStreamErrorScreenCaptureWindowRecoverFromHidden`
* `LocalVideoStreamErrorScreenCaptureWindowRecoverFromMinimized`
* `d3d11_texture_2d` and `texture_slice_index` in `ExternalVideoFrame`
* `VideoTextureId3d11texture2d` in `VideoPixelFormat`
* `isFeatureAvailableOnDevice`
* `FeatureType`
### v4.2.1 [#v421-5]
This version was released on June 21, 2023.
#### Improvements [#improvements-96]
This version improves the network transmission strategy, enhancing the smoothness of audio interactions.
#### Issues fixed [#issues-fixed-92]
This version fixed the following issues:
* Inability to join channels caused by SDK's incompatibility with some older versions of AccessToken.
* After the sending end called `setAINSMode` to activate AI noise reduction, occasional echo was observed by the receiving end.
* Brief noise occurred while playing media files using the media player.
### v4.2.0 [#v420-5]
v4.2.0 was released on May 29, 2023.
#### Compatibility changes [#compatibility-changes-53]
If you use the features mentioned in this section, ensure that you modify the implementation of the relevant features after upgrading the SDK.
**1. Channel media options**
* `publishCustomAudioTrackEnableAec` is deleted. Use `publishCustomAudioTrack` instead.
* `publishCustomAudioSourceId` is renamed to `publishCustomAudioTrackId`.
**2. Virtual sound card (macOS)**
As of v4.2.0, Agora supports third-party virtual sound cards. You can use a third-party virtual sound card as the audio input or output device for the SDK. You can use the `stateChanged` callback to see whether the current input or output device selected by the SDK is a virtual sound card.
If you set AgoraALD or Soundflower as the default input or output device when joining a channel, you will not hear audio.
**3. Miscellaneous**
* `onApiCallExecuted` is deleted. Agora recommends getting the results of the API implementation through relevant channels and media callbacks.
* The `IAudioFrameObserver` class is renamed to `IAudioPcmFrameSink`, thus the prototypes of the following methods are updated accordingly:
* `onFrame`
* `registerAudioFrameObserver` and `unregisterAudioFrameObserver` in `IMediaPlayer`
* `startChannelMediaRelay`, `updateChannelMediaRelay`, `startChannelMediaRelayEx`, and `updateChannelMediaRelayEx` are deprecated. Use `startOrUpdateChannelMediaRelay` and `startOrUpdateChannelMediaRelayEx` instead.
#### New features [#new-features-89]
**AI Noise Suppression**
This release introduces public APIs for the AI Noise Suppression function. Once enabled, the SDK automatically detects and reduces background noises. Whether in bustling public venues or real-time competitive arenas that demand lightning-fast responsiveness, this function guarantees optimal audio clarity, providing users with an elevated audio experience. You can enable this function through the newly-introduced `setAINSMode` method and set the noise reduction mode as balance, aggressive, or low latency according to your use-case.
Agora charges separately for this function. See [AI Noise Suppression unit pricing](pricing-legacy.md#ai-noise-suppression-pricing).
#### Improvements [#improvements-97]
**1. Voice changer**
This release introduces the `setLocalVoiceFormant` method that allows you to adjust the formant ratio to change the timbre of the voice. This method can be used together with the `setLocalVoicePitch` method to adjust the pitch and timbre of voice at the same time, enabling a wider range of voice transformation effects.
**2. Channel media relay**
This release introduces `startOrUpdateChannleMediaRelay` and `startOrUpdateChannleMediaRelayEx`, allowing for a simpler and smoother way to start and update media relay across channels. With these methods, developers can easily start the media relay across channels and update the target channels for media relay with a single method. Additionally, the internal interaction frequency has been optimized, effectively reducing latency in function calls.
**3. Custom audio tracks**
To better meet the needs of custom audio capture use-cases, this release adds `createCustomAudioTrack` and `destroyCustomAudioTrack` for creating and destroying custom audio tracks. Two types of audio tracks are also provided for users to choose from, further improving the flexibility of capturing external audio source:
* Mixable audio track: Supports mixing multiple external audio sources and publishing them to the same channel, suitable for multi-channel audio capture use-cases.
* Direct audio track: Only supports publishing one external audio source to a single channel, suitable for low-latency audio capture use-cases.
#### Issues fixed [#issues-fixed-93]
This release fixed the following issues:
* When the host frequently switched the user role between broadcaster and audience in a short period of time, the audience members could not hear the audio of the host.
* The receiver was receiving the low-quality stream originally and automatically switched to the high-quality stream after a few seconds (macOS).
* Incorrect information in the type field of the return value after calling `getDefaultAudioDevice` (macOS).
* Playing audio files with a sample rate of 48 kHz failed.
#### API changes [#api-changes-57]
**Added**
* `startOrUpdateChannelMediaRelay`
* `startOrUpdateChannelMediaRelayEx`
* `getNtpWallTimeInMs`
* `getCurrentMonotonicTimeInMs`
* `setAINSMode`
* `createAudioCustomTrack`
* `destroyAudioCustomTrack`
* `AudioTrackConfig`
* `AudioAinsMode`
* `AudioTrackType`
* The `domainLimit` and `autoRegisterAgoraExtensions` members in `RtcEngineContext`
**Deprecated**
* `startChannelMediaRelay`
* `startChannelMediaRelayEx`
* `updateChannelMediaRelay`
* `updateChannelMediaRelayEx`
* `onChannelMediaRelayEvent`
* `ChannelMediaRelayEvent`
**Deleted**
* `onApiCallExecuted`
* `publishCustomAudioTrackEnableAec` in `ChannelMediaOptions`
### v4.1.0 [#v410-5]
v4.1.0 was released on December 20, 2022.
#### New features [#new-features-90]
**1. In-ear monitoring**
This release adds support for in-ear monitoring. You can call `enableInEarMonitoring` to enable the in-ear monitoring function.
To adjust the in-ear monitoring volume, you can call `setInEarMonitoringVolume`.
**2. Local network connection types**
To make it easier for users to know the connection type of the local network at any stage, this release adds the
`getNetworkType` method. You can use this method to get the type of network connection in use. The available values
are `UNKNOWN`, `DISCONNECTED`, `LAN`, `WIFI`, `2G`, `3G`, `4G`, and `5G`. When the local network connection type changes, the SDK triggers the `onNetworkTypeChanged` callback to report the current network connection type.
**3. Audio stream filter**
This release introduces filtering audio streams based on volume. Once this function is enabled, the Agora server ranks all audio streams by volume and transports the three audio streams with the highest volumes to the receivers by default. The number of audio streams to be transported can be adjusted; contact [support@agora.io](mailto\:support@agora.io) to adjust this number according to your use-case.
Agora also supports publishers in choosing whether the audio streams being published are to be filtered based on volume. Streams that are not filtered bypass this filter mechanism and are transported directly to the receivers. In use-cases with a number of publishers, enabling this function helps reduce the bandwidth and device system pressure for the receivers.
To enable this function, contact
[support@agora.io](mailto:support@agora.io/)
.
**4. Loopback device (Windows)**
The SDK uses the playback device as the loopback device by default. As of 4.1.0, you can specify a loopback device separately and publish the captured audio to the remote end.
* `setLoopbackDevice`: Specifies the loopback device. If you do not want the current playback device to be the loopback device, you can call this method to specify another device as the loopback device.
* `getLoopbackDevice`: Gets the current loopback device.
* `followSystemLoopbackDevice`: Whether the loopback device follows the default playback device of the system.
**5. Spatial audio effect**
This release adds the following features applicable to spatial audio effect use-cases, which can effectively enhance the user's sense-of-presence experience in virtual interactive use-cases.
* Sound insulation area: You can set a sound insulation area and sound attenuation parameter by calling `setZones`. When the sound source (which can be a user or the media player) and the listener belong to the inside and outside of the sound insulation area, the listener experiences an attenuation effect similar to that of the sound in the real environment when it encounters a building partition. You can also set the sound attenuation parameter for the media player and the user by calling `setPlayerAttenuation` and `setRemoteAudioAttenuation` respectively, and specify whether to use that setting to force an override of the sound attenuation parameter in `setZones`.
* Doppler sound: You can enable Doppler sound by setting the `enable_doppler` parameter in `SpatialAudioParams`. The receiver experiences noticeable tonal changes in the event of a high-speed relative displacement between the source and receiver (such as in a racing game use-case).
* Headphone equalizer: You can use a preset headphone equalization effect by calling the `setHeadphoneEQPreset` method to improve the audio experience for users with headphones. If you cannot achieve the expected headphone EQ effect after calling `setHeadphoneEQPreset`, you can call `setHeadphoneEQParameters` to adjust the EQ.
**6. Headphone equalization effect**
This release adds the `setHeadphoneEQParameters` method, which is used to adjust the low- and high-frequency parameters of the headphone EQ. This mainly useful in spatial audio use-cases. If you cannot achieve the expected headphone EQ effect after calling `setHeadphoneEQPreset`, you can call `setHeadphoneEQParameters` to adjust the EQ.
**7. MPUDP (MultiPath UDP) (Beta)**
As of this release, the SDK supports MPUDP protocol, which enables you to connect and use multiple paths to maximize the use of channel resources based on the UDP protocol. You can use different physical NICs on both mobile and desktop and aggregate them to effectively combat network jitter and improve transmission quality.
To enable this feature, contact
[support@agora.io](mailto:support@agora.io)
.
**8. Register extensions (Windows)**
This release adds the `registerExtension` method for registering extensions. When using a third-party extension, you need to call the extension-related APIs in the following order:
`loadExtensionProvider` -> `registerExtension` -> `setExtensionProviderProperty` -> `enableExtension`
**9. Device management**
This release adds a series of callbacks to help you better understand the status of your audio devices:
* `onAudioDeviceStateChanged`: Occurs when the status of the audio device changes.
* `onAudioDeviceVolumeChanged`: Occurs when the volume of an audio device or app changes.
**10. Multi-channel management**
This release adds a series of multi-channel-related methods that you can call to manage audio in multi-channel use-cases.
* The `muteLocalAudioStreamEx` method is used to cancel or resume publishing a local audio stream.
* The `muteAllRemoteAudioStreamsEx` is used to cancel or resume the subscription of all remote users to audio.
* The `startRtmpStreamWithoutTranscodingEx`, `startRtmpStreamWithTranscodingEx`, `updateRtmpTranscodingEx`, and `stopRtmpStreamEx` methods are used to implement Media Push in multi-channel use-cases.
* The `startChannelMediaRelayEx`, `updateChannelMediaRelayEx`, `pauseAllChannelMediaRelayEx`, `resumeAllChannelMediaRelayEx`, and `stopChannelMediaRelayEx` methods are used to relay media streams across channels in multi-channel use-cases.
* The `options` parameter in the `leaveChannelEx` method is used to choose whether to stop recording with the microphone when leaving a channel in a multi-channel use-case.
#### Improvements [#improvements-98]
**1. Relaying media streams across channels**
This release optimizes the `updateChannelMediaRelay` method as follows:
* Before v4.1.0: If the target channel update fails due to internal reasons in the server, the SDK returns the error code `RelayEventPacketUpdateDestChannelRefused (8)`, and you need to call the `updateChannelMediaRelay` method again.
* v4.1.0 and later: If the target channel update fails due to internal server reasons, the SDK retries the update until the target channel update is successful.
**2. Reconstructed AIAEC algorithm**
This release reconstructs the AEC algorithm based on the AI method. Compared with the traditional AEC algorithm, the new algorithm can preserve the complete, clear, and smooth near-end vocals under poor echo-to-signal conditions, significantly improving the system's echo cancellation and dual-talk performance. This gives users a more comfortable call and live-broadcast experience. AIAEC is suitable for conference calls, chats, karaoke, and other use-cases.
**Other improvements**
This release includes the following additional improvements:
* Reduces the latency when pushing external audio sources.
* Improves the performance of echo cancellation when using the `audioScenarioMeeting` scenario.
* Enhances the ability to identify different network protocol stacks and improves the SDK's access capabilities in multiple-operator network use-cases.
#### Issues fixed [#issues-fixed-94]
This release fixes the following issues:
**All**
The call `getExtensionProperty` failed and returned an empty string.
**macOS**
After starting and stopping the audio capture device test, there was no sound when the audio playback device was subsequently started.
#### API changes [#api-changes-58]
**Added**
* `getNativeHandle`
* `getPlaybackDefaultDevice`
* `getRecordingDefaultDevice`
* `getNetworkType`
* `setLoopbackDevice` (Windows)
* `getLoopbackDevice` (Windows)
* `followSystemLoopbackDevice` (Windows)
* `setZones`
* `setRemoteAudioAttenuation`
* `setHeadphoneEQPreset`
* `setHeadphoneEQParameters`
* `HeadphoneEqualizerPreset`
* `adjustUserPlaybackSignalVolumeEx`
* `RhythmPlayerStateType`
* `RhythmPlayerErrorType`
* `enableAudioVolumeIndicationEx`
* `onAudioDeviceStateChanged`
* `onAudioDeviceVolumeChanged`
* `registerExtension` (Windows)
* `muteLocalAudioStreamEx`
* `muteAllRemoteAudioStreamsEx`
* `startRtmpStreamWithoutTranscodingEx`
* `startRtmpStreamWithTranscodingEx`
* `updateRtmpTranscodingEx`
* `stopRtmpStreamEx`
* `startChannelMediaRelayEx`
* `updateChannelMediaRelayEx`
* `pauseAllChannelMediaRelayEx`
* `resumeAllChannelMediaRelayEx`
* `stopChannelMediaRelayEx`
**Modified**
* Adds `isAudioFilterable` in `ChannelMediaOptions`
* Adds `enable_doppler` in `SpatialAudioParams`
* Adds `options` in `leaveChannelEx`
* Adds `newRoleOptions` in `onClientRoleChanged`
* `enableInEarMonitoring`: Supports Windows and macOS
* `setEarMonitoringAudioFrameParameters`: Supports Windows and macOS
* `setInEarMonitoringVolume`: Supports Windows and macOS
* `onEarMonitoringAudioFrame`: Supports Windows and macOS
* `ScreenCaptureParameters`: Supports Windows
**Deprecated**
* `onApiCallExecuted`: Use the callbacks triggered by specific methods instead.
* `RelayEventPacketUpdateDestChannelRefused (8)` in `ChannelMediaRelayEvent`
### v4.0.0 [#v400-5]
v4.0.0 was released on September 29, 2022.
#### Compatibility changes [#compatibility-changes-54]
**Integration change**
This release has changed the SDK package name from `electron-agora-rtc-ng` to `agora-electron-sdk`, and optimized the implementation of some features, resulting in incompatibility with v3.7.0. The following are the main features with compatibility changes:
* Multiple channel
* Media stream publishing control
* Warning codes
After upgrading the SDK, you need to update the code in your app according to your business use-cases. For details, see [Migration guide](./migration-guide).
#### New features [#new-features-91]
**1. Multiple media tracks**
This release supports one `IRtcEngine` instance to collect multiple audio and video sources at the same time and publish them to the remote users by setting `RtcEngineEx` and `ChannelMediaOptions.`
* After calling `joinChannel` to join the first channel, call `joinChannelEx` multiple times to join multiple channels, and publish the specified stream to different channels through different user ID (`localUid`) and `ChannelMediaOptions` settings.
* You can simultaneously publish multiple sets of video streams captured by multiple cameras or screen sharing by setting `publishSecondaryCameraTrack` and `publishSecondaryScreenTrack` in `ChannelMediaOptions`.
This release adds `createCustomVideoTrack` method to implement video custom capture. You can refer to the following steps to publish multiple custom captured video in the channel:
1. Create a custom video track: Call this method to create a video track, and get the video track ID.
2. Set the custom video track to be published in the channel: In each channel's `ChannelMediaOptions`, set the `customVideoTrackId` parameter to the ID of the video track you want to publish, and set `publishCustomVideoTrack` to `true`.
3. Pushing an external video source: Call `pushVideoFrame`, and specify `videoTrackId` as the ID of the custom video track in step 2 in order to publish the corresponding custom video source in multiple channels.
You can also experience the following features with the multi-channel capability:
* Publish multiple sets of audio and video streams to the remote users through different user IDs (`uid`).
* Mix multiple audio streams and publish to the remote users through a user ID (`uid`).
* Combine multiple video streams and publish them to the remote users through a user ID (`uid`).
**2. Ultra HD resolution (Beta)**
In order to improve the interactive video experience, the SDK optimizes the whole process of video capture, encoding, decoding and rendering, and now supports 4K resolution. The improved FEC (Forward Error Correction) algorithm enables adaptive switches according to the frame rate and number of video frame packets, which further reduces the video stuttering rate in 4K scenes. Additionally, you can set the encoding resolution to 4K (3840 × 2160) and the frame rate to 60 fps when calling `SetVideoEncoderConfiguration`. The SDK supports automatic fallback to the appropriate resolution and frame rate if your device does not support 4K.
> ***NOTE:*** This feature has certain requirements with regards to device performance and network bandwidth, and the supported upstream and downstream frame rates vary on different platforms. To experience this feature, contact [technical support](mailto\:support@agora.io).
**3. Agora media player**
To make it easier for users to integrate the Agora SDK and reduce the SDK's package size, this release introduces the Agora media player. After calling the `createMediaPlayer` method to create a media player object, you can then call the methods in the `IMediaPlayer` class to experience a series of functions, such as playing local and online media files, preloading a media file, changing the CDN route for playing according to your network conditions, or sharing the audio and video streams being played with remote users.
* Plays local and online media files.
* Preloads media files.
* Changes the CDN route for playing media files according your network conditions.
* Shares the audio and video streams being played with remote users.
* Caches data when playing media files.
**3.Brand-new AI Noise Suppression**
The SDK supports a new version of AI noise reduction (in comparison to the basic AI noise reduction in v3.7.0). The new AI noise reduction has better vocal fidelity, cleaner noise suppression, and adds a dereverberation option.
> ***NOTE:*** To experience this feature, contact [support@agora.io](mailto\:support@agora.io).
**5. Ultra-high audio quality**
To make the audio clearer and restore more details, this release adds the `UltraHighQualityVoice` enumeration. In use-cases that mainly feature the human voice, such as chat or singing, you can call `setVoiceBeautifierPreset` and use this enumeration to experience ultra-high audio quality.
**6. Real-time chorus**
This release gives real-time chorus the following abilities:
* Two or more choruses are supported.
* Each singer is independent of each other. If one singer fails or quits the chorus, the other singers can continue to sing.
* Very low latency experience. Each singer can hear each other in real time, and the audience can also hear each singer in real time.
This release adds the `AudioScenarioChorus` enumeration in `AudioScenarioType`. With this enumeration, users can experience ultra-low latency in real-time chorus when the network conditions are good.
**7. Enhanced channel management**
To meet the channel management requirements of various business use-cases, this release adds the following functions to the `ChannelMediaOptions` structure:
* Sets or switches the publishing of multiple audio and video sources.
* Sets or switches channel profile and user role.
* Sets or switches the stream type of the subscribed video.
* Controls audio publishing delay.
Set `ChannelMediaOptions` when calling `joinChannel` or `joinChannelEx` to specify the publishing and subscription behavior of a media stream, for example, whether to publish video streams captured by cameras or screen sharing, and whether to subscribe to the audio and video streams of remote users. After joining the channel, call `updateChannelMediaOptions` to update the settings in `ChannelMediaOptions` at any time, for example, to switch the published audio and video sources.
**8. Screen sharing**
This release optimizes the screen sharing function. You can enable this function in the following ways.
* Call the `StartScreenCaptureByDisplayId` method before joining a channel, and then call `JoinChannel` \[2/2] to join a channel and set `publishScreenTrack` or `publishSecondaryScreenTrack` as true.
* Call the `StartScreenCaptureByDisplayId` method after joining a channel, and then call `UpdateChannelMediaOptions` to set `publishScreenTrack` or `publishSecondaryScreenTrack` as true.
**9. Subscription allowlists and blocklists**
This release introduces subscription allowlists and blocklists for remote audio and video streams. You can add a user ID that you want to subscribe to in your allowlist, or add a user ID for the streams you do not wish to see to your blocklists. You can experience this feature through the following APIs, and in use-cases that involve multiple channels, you can call the following methods in the `IRtcEngineEx` interface:
* `SetSubscribeAudioBlocklist`：Set the audio subscription blocklist.
* `SetSubscribeAudioAllowlist`：Set the audio subscription allowlist.
* `SetSubscribeVideoBlocklist`：Set the video subscription blocklist.
* `SetSubscribeVideoAllowlist`：Set the video subscription allowlist.
If a user is added in a blocklist and a allowlist at the same time, only the blocklist takes effect.
**10. Set audio scenarios**
To make it easier to change audio scenarios, this release adds the `SetAudioScenario` method. For example, if you want to change the audio scenario from `AudioScenarioDefault` to `AudioScenarioGameStreaming` when you are in a channel, you can call this method.
**11. Replace video feeds with images**
This release supports replacing video feeds with images when publishing video streams. You can call the `enableVideoImageSource` method to enable this function and choose your own images through the `options` parameter. If you disable this function, the remote users see the video feeds that you publish.
**12. Local video mixing**
This release adds a series of APIs supporting local video mixing functions. You can mix multiple video streams into one video stream locally. Common use-cases are as follows:
* In interactive live streaming use-cases with cohosts or when using the Media Push function, you can merge the screens of multiple hosts into one view locally.
* In use-cases where you capture multiple local video streams (for example, video captured by cameras, screen sharing streams, video files or pictures), you can and merge them into one video stream and then publish the mixed video stream in the channel.
You can call the `startLocalVideoTranscoder` method to start local video mixing and call the `stopLocalVideoTranscoder` method to stop local video mixing. After the local video mixing starts, you can call `updateLocalTranscoderConfiguration` to update the local video mixing configuration.
**13. Video device management**
Video capture devices can support multiple video formats, each supporting a different combination of video frame width, video frame height, and frame rate.
This release adds the `numberOfCapabilities` and `getCapability` methods for getting the number of video formats supported by the video capture device and the details of the video frames in the specified video format. When calling the `startPrimaryCameraCapture` or `startSecondaryCameraCapture` method to capture video using the camera, you can use the specified video format.
> ***NOTE:*** The SDK automatically selects the best video format for the video capture device based on your settings in `VideoEncoderConfiguration`, so normally you should not need to use these new methods.
#### Improvements [#improvements-99]
**1. Fast channel switching**
This release can achieve the same switching speed as `SwitchChannel` in v3.7.0 through the `LeaveChannel` and `JoinChannel `methods so that you don't need to take the time to call the `SwitchChannel `method.
**2. Push external video frames**
This releases supports pushing video frames in I422 format. You can call the `pushVideoFrame`\[1/2] method to push such video frames to the SDK.
**3. Voice pitch of the local user**
This release adds `voicePitch` in `AudioVolumeInfo` of `onAudioVolumeIndication`. You can use `voicePitch` to get the local user's voice pitch and perform business functions such as rating for singing.
**4. Video preview**
This release improves the implementation logic of `startPreview`. You can call the `startPreview `method to enable video preview at any time.
**5. Video types of subscription**
You can call the `setRemoteDefaultVideoStreamType` method to choose the video stream type when subscribing to streams.