Release notes
Updated
Information about changes in each release of Voice Calling.
Known issues
The list of known issues page is continuously updated as the systems evolve. Agora suggests you regularly upgrade to the latest version of the SDK, which includes new features, bug fixes and improvements.
-
React Native SDK v4.2.6
AirPods Pro Bluetooth connection issue (iOS)
AirPods Pro does not support the A2DP protocol in the communication audio mode, which may lead to connection failure in this mode.
v4.6.2
Released on March 14, 2026.
Compatibility changes
This release introduces the following compatibility changes:
-
Deprecation of Direct CDN streaming APIs
The following APIs related to Direct CDN streaming are deprecated in this release and will be removed in a future version. Use server-side transcoding and media push instead.
setDirectCdnStreamingAudioConfigurationsetDirectCdnStreamingVideoConfigurationstartDirectCdnStreamingstopDirectCdnStreamingDirectCdnStreamingMediaOptionsDirectCdnStreamingStatsDirectCdnStreamingStateDirectCdnStreamingReason
-
Deprecation of virtual metronome APIs
The following APIs related to the virtual metronome feature are deprecated in this release and will be removed in a future version.
startRhythmPlayerconfigRhythmPlayeronRhythmPlayerStateChanged
-
Removal of redundant APIs
The following APIs and parameters are removed in this release:
setLocalPublishFallbackOptiononLocalPublishFallbackToAudioOnlyonDownlinkNetworkInfoUpdatedonWlAccStatsenableWirelessAccelerate
-
New domains required for domain whitelist
If you upgrade from a previous version and use the domain whitelist feature (
domainLimitinRtcEngineConfigset totrue), add the following domains to ensure uninterrupted communication:*.rtnsvc.com*.realtimemesh.com
New features
Included in this release:
-
Multi-path network transmission
This release introduces multi-path transmission for devices that support multiple network interfaces (such as 5G, Wi-Fi, and LAN). This feature reduces or eliminates experience degradation caused by poor network conditions, making it suitable for real-time audio and video communication in challenging environments such as vehicles, IoT devices, trains, and highways.
Enable multi-path transmission by setting
enableMultipathtotrueinChannelMediaOptions. Two transmission modes are supported throughMultipathMode:- Dynamic mode (default): Dynamically selects the best available path based on network conditions. Suited for traffic-sensitive scenarios with high experience requirements, such as meetings and online education. In this mode, you can specify the preferred network path (for example, Wi-Fi or mobile network) using
preferMultipathType. - Full redundancy mode: Transmits data simultaneously on all available network paths. Suited for scenarios that are not traffic-sensitive but require extreme reliability, such as outdoor broadcasting and parallel control. This mode incurs additional costs. Contact technical support to enable it.
Uplink and downlink paths can also be configured separately using
uplinkMultipathModeanddownlinkMultipathModeinChannelMediaOptions. Once enabled, the SDK reports real-time transmission statistics for each path through theonMultipathStatscallback, including per-path traffic consumption. - Dynamic mode (default): Dynamically selects the best available path based on network conditions. Suited for traffic-sensitive scenarios with high experience requirements, such as meetings and online education. In this mode, you can specify the preferred network path (for example, Wi-Fi or mobile network) using
-
Token renewal result callback
This release introduces the
onRenewTokenResultcallback and theRenewTokenErrorCodeerror code enum. After callingrenewTokento update the token, the SDK reports the result throughonRenewTokenResultand returns detailed error codes defined inRenewTokenErrorCode, allowing you to handle token renewal failure scenarios accordingly. -
Media Player support for getting audio buffer delay
To address synchronization issues between the main vocal and background accompaniment in karaoke scenarios, this release adds the
getAudioBufferDelaymethod to the Media Player module. This method returns the millisecond-level audio buffer delay when playing media files. -
Other new features
- Adds the
setPlaybackAudioFrameBeforeMixingParametersmethod to set the audio frame format returned in theonPlaybackAudioFrameBeforeMixingcallback, including sample rate, number of channels, and number of data samples per callback. After calling this method, the SDK returns the original pre-mix audio data according to the specified parameters. - Adds the
preloadEffectExmethod to preload sound effect files into specified channels, supporting both local and online files for use in multi-channel scenarios. - Adds the
playEffectExmethod to play sound effect files in specified channels with configurable parameters, including loop count, pitch, spatial position, volume, whether to publish to the channel, and playback start position.
- Adds the
Improvements
This release includes the following enhancements:
-
Seamless switching for sound effect files
Adds support for seamless switching of sound effect files. For the same sound effect file, if you call
preloadEffectfollowed byplayEffect, the SDK does not close the file after playback completes or whenstopEffectis called. When you callplayEffectagain, the SDK reuses the loaded file to enable loop playback and seamless switching. This feature also works in multi-channel scenarios. -
Improved accuracy of network quality evaluation
Improves the accuracy of network quality evaluation in the
onNetworkQualitycallback, making the reported data better reflect the user's perceived experience. -
Support for 24kHz sampling rate for audio playback
Adds support for audio data with a sample rate of 24000 Hz in
onPlaybackAudioFrame. When callingsetPlaybackAudioFrameParametersto set the playback audio format, you can setsampleRateto24000. -
Additional improvements
- Optimizes permission requests on Windows 11 24H2 and later to avoid unnecessary location data acquisition.
- Adds support for G.711 and G.722 audio codecs when interoperating with Web clients, improving cross-platform audio compatibility and clarity.
- Adds error codes
ERR_PCMSEND_FORMAT (200)andERR_PCMSEND_BUFFEROVERFLOW (201)to report PCM data transmission errors.
Issues fixed
This release fixes the following issues:
- When playing multi-track songs with guide vocal enabled, noise occurred after calling
setAudioPitchto adjust the pitch. - When a broadcaster created a custom audio capture track using
createCustomAudioTrackwithtrackTypeset toAudioTrackDirect, pushed self-captured audio usingpushAudioFrame, and then played sound effects usingplayEffect, the audience in the channel heard noise in the broadcaster's audio. - Apps integrated with the SDK occasionally experienced UI freezing due to main thread blocking during audio and video engagements.
- Receivers occasionally heard noise when the sender transmitted multi-channel encoded audio.
- When calling
opentwice to open different media resources, theonPlayerInfoUpdatedcallback returned information about the first resource when opening the second, which was incorrect. - When calling
enableAudioVolumeIndicationto enable volume indication for local streaming users and remote users, the local user volume returned byonAudioVolumeIndicationwas 0. - After calling
opento open an online sound effect file andplayEffectto start playback, callingseekto set the playback position caused the file to play from the beginning instead of the specified position. - In media volume mode, when a broadcaster published microphone audio while simultaneously playing sound effects with
playEffectand a music file withstartAudioMixing, echo occasionally occurred. - After calling
joinChannelExto join a channel andstartOrUpdateChannelMediaRelayto start cross-channel media relay, rejoining the channel after going offline and leaving occasionally causedonChannelMediaRelayStateChangedto reportstateasRelayStateFailurewithcodeasRelayErrorServerErrorResponse. - On some laptop models with power-saving mode enabled, receivers occasionally heard echo when the sender shared screen and audio.
v4.5.1
v4.5.1 was released on March 13, 2025.
New features
-
AI conversation scenario
This version adds the
AudioScenarioAiClientaudio scenario specifically designed for interacting with the conversational AI agent created by Conversational AI Engine. This scenario optimizes the audio transmission algorithm based on AI-generated voice characteristics, ensuring stable voice data transmission even in weak network conditions with up to 80% packet loss. It enhances conversation continuity and reliability while adapting to complex network conditions.
Improvements
- Reduces the SDK initialization time on specific device models. (iOS)
Issues fixed
This release fixes the following issues:
- Apps that integrated the Agora SDK and set the
targetSdkVersionto 34 encountered crashes when attempting to enable screen sharing for the first time on an Android 14 system. (Android) - When joining two or more channels simultaneously, and calling the
takeSnapshotExmethod to take screenshots of the local video streams in each channel consecutively, the screenshot of the first channel failed. - When using the
pausemethod to pause playback, then callingseekto move to a specified position, and finally callingplayto continue playback, the Media Player resumed from the position where it was paused, not the new specified position. - When using the Media Player, the file path of the media resource returned by the
getPlaySrcdid not change after calling theswitchSrcmethod to switch to a new media resource. - When using Bluetooth headphones on specific device models for audio and video interactions, adjusting the phone volume would occasionally change the media volume instead of the Bluetooth volume. (Android)
- During audio and video interactions, the local user occasionally experienced a black screen when watching the video streams of remote users. (Android)
- On specific device models, after calling
setCameraExposureFactorto set the exposure coefficient of the current camera at a specific angle of the device, the video screen occasionally became dark when the device was moved to another angle. (Android) - When playing a CDN live stream, the video occasionally froze for an extended period after recovering from an interruption. (Android)
- When pushing video frames in i420 format to the channel, using CVPixelBuffer to handle these frames caused a crash. (iOS)
- When two views are created before calling
enableFaceDetectionto start face detection, no face information can be detected in the subsequently passed views. (iOS) - In a screen sharing scenario, the receiving-end user saw a green line on the shared image. (iOS)
- In the interactive live streaming scenario, after joining a channel to watch live streams using
stringuser id, the audience members occasionally saw that the audio was not synchronized with the video. - Plugins sometimes did not work when using AI noise suppression and AI echo cancellation plugins at the same time.
v4.5.0
v4.5.0 was released on December 10, 2024.
Compatibility changes
This version includes optimizations to some features, including changes to SDK behavior and API renaming and deletion. To ensure normal operation of the project, update the code in the app after upgrading to this release.
-
Changes in strong video noise suppression implementation
This version adjusts the implementation of strong video noise suppression.
VideoDenoiserLevelStrengthis removed fromVideoDenoiserLevel. Instead, after enabling video noise suppression by callingsetVideoDenoiserOptions, you can call thesetBeautyEffectOptionsmethod to enable the beauty skin smoothing feature. Using both together will help achieve better video noise suppression effects. For strong noise suppression, it is recommended to set the skin smoothing parameters as detailed insetVideoDenoiserOptions.Additionally, due to this adjustment, to achieve the best low-light enhancement effect with a focus on image quality, enable video noise suppression first and use specific settings as detailed in
setLowlightEnhanceOptions. -
Changes in video encoding preferences
To enhance the user’s video interaction experience, this version optimizes the default preferences for video encoding:
- In the
CompressionPreferenceenumeration class, a newPreferCompressionAuto(-1) enumeration is added, replacing the originalPreferQuality(1) as the default value. In this mode, the SDK will automatically choose betweenPreferLowLatencyandPreferQualitybased on your video scene settings to achieve the best user experience. - In the
DegradationPreferenceenumeration class, a newMaintainAuto(-1) enumeration is added, replacing the originalMaintainQuality(1) as the default value. In this mode, the SDK will automatically choose betweenMaintainFramerate,MaintainBalanced, andMaintainResolutionbased on your video scene settings to achieve the optimal overall quality experience (QoE).
- In the
-
16 KB memory page size (Android)
Starting from Android 15, the system adds support for 16 KB memory page size, as detailed in Support 16 KB page sizes. To ensure the stability and performance of the app, starting from this version, the SDK supports 16 KB memory page size, ensuring seamless operation on devices with both 4 KB and 16 KB memory page sizes, enhancing compatibility and preventing crashes.
New features
-
Live show scenario
This version adds the
ApplicationScenarioLiveshow(3) (Live Show) enumeration toVideoApplicationScenarioType. You can callsetVideoScenarioto set the video business scenario to show room. In this scenario, fast video rendering and high image quality are crucial. The SDK implements several performance optimizations, such as enabling accelerated audio and video frame rendering to minimize first-frame latency (no need to callenableInstantMediaRendering) to achieve better image quality and bandwidth efficiency. -
Maximum frame rate for video rendering
This version adds the
setLocalRenderTargetFpsandsetRemoteRenderTargetFpsmethods, which support setting the maximum frame rate for video rendering locally and remotely. The actual frame rate for video rendering by the SDK will be as close to this value as possible.In use-cases where the frame rate requirement for video rendering is not high (e.g., screen sharing, online education) or when the remote end uses mid-to-low-end devices, you can use this set of methods to limit the video rendering frame rate, thereby reducing CPU consumption and improving system performance.
-
Filter effects
This version introduces the
setFilterEffectOptionsmethod. You can pass a cube map file (.cube) in theconfigparameter to achieve custom filter effects such as whitening, vivid, cool, black and white, etc. Additionally, the SDK provides a built-inbuilt_in_whiten_filter.cubefile for quickly achieving a whitening filter effect. -
Local audio mixing
This version introduces the local audio mixing feature. You can call the
startLocalAudioMixermethod to mix the audio streams from the local microphone, media player, sound card, and remote audio streams into a single audio stream, which can then be published to the channel. When you no longer need audio mixing, you can call thestopLocalAudioMixermethod to stop local audio mixing. During the mixing process, you can call theupdateLocalAudioMixerConfigurationmethod to update the configuration of the audio streams being mixed.Example use cases for this feature include:
- By utilizing the local video mixing feature, the associated audio streams of the mixed video streams can be simultaneously captured and published.
- In live streaming use-cases, users can receive audio streams within the channel, mix multiple audio streams locally, and then forward the mixed audio stream to other channels.
- In educational use-cases, teachers can mix the audio from interactions with students locally and then forward the mixed audio stream to other channels.
-
External MediaProjection (Android)
This version introduces the
setExternalMediaProjectionmethod, which allows you to set an externalMediaProjectionand replace theMediaProjectionapplied by the SDK.If you have the capability to apply for
MediaProjectionon your own, you can use this feature to achieve more flexible screen capture. -
EGL context (Android)
This version introduces the
setExternalRemoteEglContextmethod, which is used to set the EGL context for rendering remote video streams. When using Texture format video data for remote video self-rendering, you can use this method to replace the SDK's default remote EGL context, achieving unified EGL context management. -
Color space settings
This version adds the colorSpace parameter to
VideoFrameandExternalVideoFrame. You can use this parameter to set the color space properties of the video frame. By default, the color space uses Full Range and BT.709 standard configuration. You can flexibly adjust according to your own capture or rendering needs, further enhancing the customization capabilities of video processing.
Improvements
-
Virtual background algorithm optimization
This version upgrades the virtual background algorithm, making the segmentation between the portrait and the background more accurate. There is no background exposure, the body contour of the portrait is complete, and the detail recognition of fingers is significantly improved. Additionally, the edges between the portrait and the background are more stable, reducing edge jumping and flickering in continuous video frames.
-
Snapshot at specified video observation points
This version introduces the
takeSnapshotWithConfigandtakeSnapshotWithConfigExmethods. You can use theconfigparameter when calling these methods to take snapshots at specified video observation points, such as before encoding, after encoding, or before rendering, to achieve more flexible snapshot effects. -
Custom audio capture improvements
This version adds the
enableAudioProcessingmember parameter toAudioTrackConfig, which is used to control whether to enable 3A audio processing for custom audio capture tracks of theAUDIO_TRACK_DIRECTtype. The default value of this parameter isfalse, meaning that audio processing is not enabled. Users can enable it as needed, enhancing the flexibility of custom audio processing. -
Other improvements
- In use-cases where Alpha transparency effects are achieved by stitching video frames and Alpha data, the rendering performance on the receiving end has been improved, effectively reducing stuttering and latency.
- Optimizes the logic for calling
queryDeviceScoreto obtain device score levels, improving the accuracy of the score results. - After calling
enableLocalAudioto disable local audio capture within the channel, the mute side button on the phone can be used to mute the background sound effects played by the app. (iOS) - When calling
switchSrcto switch between live streams or on-demand streams of different resolutions, smooth and seamless switching can be achieved. An automatic retry mechanism has been added in case of switching failures. The SDK will automatically retry 3 times after a failure. If it still fails, theonPlayerEventcallback will report thePlayerEventSwitchErrorevent, indicating an error occurred during media resource switching. - When calling
setPlaybackSpeedto set the playback speed of an audio file, the minimum supported speed is 0.3x.
Issues fixed
This version fixes the following issues:
- When the video source type of the sender is in JPEG format, the frame rate on the receiving end occasionally falls below expectations.
- During audio and video interaction, after being interrupted by a system call, the user volume reported by the
onAudioVolumeIndicationcallback was incorrect. (Android) - When the receiving end subscribes to the low-quality video stream by default and does not automatically subscribe to any video stream when joining the channel, calling
muteRemoteVideoStream(uid, false)after joining the channel to resume receiving the video stream results in receiving the high-quality video stream. (Android) - Occasional instances where the receiving end cannot hear the sender during audio and video interaction. (iOS)
- During audio and video interaction, if the sender's device system version is iOS 17, the receiving end occasionally cannot hear the sender. (iOS)
- In live streaming use-cases, the time taken to reconnect to the live room after the audience end disconnects due to network switching is longer than expected. (iOS)
- No sound when playing online media resources using the media player after the app starts. (iOS)
- Occasional instances of no sound in audio capture after resuming from being interrupted by other system apps during audio and video interaction. (iOS)
- Calling
startAudioMixingand then immediately callingpauseAudioMixingto pause the music file playback does not take effect. - Occasional crashes during audio and video interaction. (Android)
v4.4.0
v4.4.0 was released on August 29, 2024.
Compatibility changes
This version includes optimizations to some features, including changes to SDK behavior and API renaming and deletion. To ensure normal operation of the project, update the code in the app after upgrading to this release.
-
To distinguish context information in different extension callbacks, this version removes the original extension callbacks and adds corresponding callbacks that contain context information (see the table below). You can identify the extension name, the user ID, and the service provider name through
ExtensionContextin each callback.Original callback New callback onExtensionEventonExtensionEventWithContextonExtensionStartedonExtensionStartedWithContextonExtensionStoppedonExtensionStoppedWithContextonExtensionErroronExtensionErrorWithContext
New features
-
Voice AI tuner
This version introduces the voice AI tuner feature, which can enhance the sound quality and tone, similar to a physical sound card. You can enable the voice AI tuner feature by calling the
enableVoiceAITunermethod. Pass in the sound effect types supported in theVoiceAiTunerTypeenum to achieve the effects such as a deep voice, cute voice, husky singing voice, and so on.
Improvements
-
Adaptive hardware decoding support (Android)
This release introduces adaptive hardware decoding support, enhancing rendering smoothness on low-end devices and effectively reducing system load.
-
Other improvements
This version also includes the following improvements:
- Optimizes the transmission strategy: Calling
enableInstantMediaRenderingno longer impacts the security of the transmission link. - Adds the
channelIdparameter toMetadata, which is used to get the channel name from which the metadata is sent. - Deprecates redundant enumeration values
ClientRoleChangeFailedRequestTimeOutandClientRoleChangeFailedConnectionFailedinClientRoleChangeFailedReason.
- Optimizes the transmission strategy: Calling
Issues fixed
This release fixed the following issues:
- Occasional app crashes occurred when multiple remote users joined the channel simultaneously during real-time interaction (iOS).
- After the sender called
startDirectCdnStreamingto start direct CDN streaming, frequent switching or toggling of the network occasionally resulted in a black screen on the receiver's end without a streaming failure callback on the sender's end (iOS). - Audio playback failed when pushing external audio data using
pushAudioFrameand the sample rate was not set to a recommended value, such as 22050 Hz and 11025 Hz.
v4.3.2
v4.3.2 was released on June 6, 2024.
Improvements
This release enhances the usability of the setRemoteSubscribeFallbackOption method by removing the timing requirements for invocation. It can now be called both before and after joining the channel to dynamically switch audio and video stream fallback options in weak network conditions.
Issues fixed
This version fixed the following issues:
- Local audio capture failed after joining a channel while answering a system phone call and hanging up, preventing remote users from hearing any sound (Android).
- During the interaction process on certain devices (for example, Redmi Note8), after answering and hanging up a system call, local media files were played without sound and no sound was heard from the remote end (Android).
- The app occasionally crashed when remote users left the channel.
- When playing an audio file finished, the SDK sometimes failed to trigger the onAudioMixingStateChanged (
AudioMixingStateStopped,AudioMixingReasonAllLoopsCompleted) callback that reports that the playing is completed (iOS). - When calling the playEffect method to play sound effect files shorter than 1 second with
loopCountset to0, there was no sound (iOS).
v4.3.1
v4.3.1 was released on May 9, 2024.
New features
-
Privacy manifest file (iOS)
To meet Apple's safety compliance requirements for app publication, the SDK now includes a privacy manifest file,
PrivacyInfo.xcprivacy, detailing the SDK's API calls that access or use user data, along with a description of the types of data collected.If you need to publish an app with SDK versions prior to v4.3.1 to the Apple App Store, manually add the
PrivacyInfo.xcprivacyfile to your Xcode project. -
Data stream encryption
This version adds
datastreamEncryptionEnabledto EncryptionConfig for enabling data stream encryption. You can set this when you activate encryption with enableEncryption. If there are issues causing failure in data stream encryption or decryption, these can be identified by the newly addedEncryptionErrorDatastreamDecryptionFailureandEncryptionErrorDatastreamEncryptionFailureenumerations. -
Other features
- A new method enableEncryptionEx is added for enabling media stream or data stream encryption in multi-channel use-cases.
- A new method setAudioMixingPlaybackSpeed is introduced for setting the playback speed of audio files.
- A new method getCallIdEx is introduced for retrieving call IDs in multi-channel use-cases.
Improvements
-
CPU consumption reduction of in-ear monitoring
This release adds an enumerator
EarMonitoringFilterReusePostProcessingFilterinEarMonitoringFilterType. For complex audio processing use-cases, you can specify this option to reuse the audio filter after sender-side processing in in-ear monitoring, thereby reducing CPU consumption. Note that this option may increase the latency of in-ear monitoring, which is suitable for latency-tolerant use-cases requiring low CPU consumption. -
Other improvements
This version also includes the following improvements:
- Enhanced performance and stability of the local compositing feature, reducing its CPU usage (Android).
- In AudioEffectPreset, a new enumeration
RoomAcousticsChorus(chorus effect) is added, enhancing the spatial presence of vocals in chorus use-cases. - In RemoteAudioStats, a new
e2eDelayfield is added to report the delay from when the audio is captured on the sending side to when the audio is played on the receiving side.
Issues fixed
This version fixed the following issues:
- Hosts using certain models of devices in the speaker mode experienced occasional local audio capture failures when switching the app process to the background and then back to the foreground, preventing remote users from hearing the host's audio (Android).
- When the network conditions of the sender deteriorated (for example, in poor network environments), the receiver occasionally experienced a decrease in video smoothness and an increase in lag.
API changes
Added
- enableCameraCenterStage (iOS)
- isCameraCenterStageSupported (iOS)
- setCameraStabilizationMode (iOS)
- CameraStabilizationMode (iOS)
- registerFaceInfoObserver
- unregisterFaceInfoObserver
- IFaceInfoObserver
- onFaceInfo
- MediaSourceType adds
SpeechDrivenVideoSource - VideoSourceType adds
VideoSourceSpeechDriven - EncryptionConfig adds
datastreamEncryptionEnabled - EncryptionErrorType adds the following enumerations:
EncryptionErrorDatastreamDecryptionFailureEncryptionErrorDatastreamEncryptionFailure
- RemoteAudioStats adds
e2eDelay - ErrorCodeType adds
ErrDatastreamDecryptionFailed - AudioEffectPreset adds
RoomAcousticsChorus, enhancing the spatial presence of vocals in chorus use-cases. - getCallIdEx
- enableEncryptionEx
- setAudioMixingPlaybackSpeed
- queryCameraFocalLengthCapability (Android, iOS)
- FocalLengthInfo (Android, iOS)
- CameraFocalLengthType (Android, iOS)
- CameraCapturerConfiguration adds a new member
cameraFocalLengthType(Android, iOS) - CameraCapturerConfiguration adds a new member
cameraId(Android) - EarMonitoringFilterType adds a new enumeration
EarMonitoringFilterBuiltInAudioFilters
v4.3.0-build.1
v4.3.0-build.1 was released on March 19, 2024.
Issues fixed
This release fixed the following issue:
Directly calling engine.release to destroy the engine without prior call of engine.unregisterEventHandler to remove all callback events could lead to App crashes (Android).
v4.3.0
v4.3.0 was released on February 28, 2024.
Compatibility changes
This release has optimized the implementation of some functions, involving renaming or deletion of some APIs. To ensure the normal operation of the project, you need to update the code in the app after upgrading to this release.
-
Renaming parameters in callbacks
In order to make the parameters in some callbacks and the naming of enumerations in enumeration classes easier to understand, the following modifications have been made in this release. Please modify the parameter settings in the callbacks after upgrading to this release.
Callback Original parameter name New parameter name onLocalAudioStateChangederrorreasononLocalVideoStateChangederrorreasononDirectCdnStreamingStateChangederrorreasononRtmpStreamingStateChangederrCodereasonOriginal enumeration class New enumeration class LocalAudioStreamErrorLocalAudioStreamReasonLocalVideoStreamErrorLocalVideoStreamReasonDirectCdnStreamingErrorDirectCdnStreamingReasonMediaPlayerErrorMediaPlayerReasonRtmpStreamPublishErrorTypeRtmpStreamPublishReasonNote: For specific renaming of enumerations, please refer to API changes.
-
Channel media relay
To improve interface usability, this release removes some methods and callbacks for channel media relay. Use the alternative options listed in the table below:
Deleted methods and callbacks Alternative methods and callbacks startChannelMediaRelay,updateChannelMediaRelaystartOrUpdateChannelMediaRelaystartChannelMediaRelayEx,updateChannelMediaRelayExstartOrUpdateChannelMediaRelayExonChannelMediaRelayEventonChannelMediaRelayStateChanged -
Audio route
Starting with this release,
RouteBluetoothin AudioRoute is renamed toRouteBluetoothDeviceHFP, representing a Bluetooth device using the HFP protocol.RouteBluetoothDeviceA2DP(10) is added to represent a Bluetooth device using the A2DP protocol. -
Log encryption behavior changes
For security and performance reasons, as of this release, the SDK encrypts logs and no longer supports printing plaintext logs via the console.
Refer to the following solutions for different needs:
- If you need to know the API call status, please check the API logs and print the SDK callback logs yourself.
- For any other special requirements, please contact technical support and provide the corresponding encrypted logs.
New features
-
Query device score
This release adds the queryDeviceScore method to query the device's score level to ensure that the user-set parameters do not exceed the device's capabilities. For example, in HD or UHD video use-cases, you can first call this method to query the device's score. If the returned score is low (for example, below 60), you need to lower the video resolution to avoid affecting the video experience. The minimum device score required for different business use-cases is varied. For specific score recommendations, please contact technical support.
-
Select different audio tracks for local playback and streaming
This release introduces the selectMultiAudioTrack method that allows you to select different audio tracks for local playback and streaming to remote users. For example, in use-cases like online karaoke, the host can choose to play the original sound locally and publish the accompaniment in the channel. Before using this function, you need to open the media file through the openWithMediaSource method and enable this function by setting the
enableMultiAudioTrackparameter in MediaSource. -
Others
This release has passed the test verification of the following APIs and can be applied to the entire series of RTC 4.x SDK.
- setRemoteSubscribeFallbackOption: Sets fallback option for the subscribed video stream in weak network conditions.
- onRemoteSubscribeFallbackToAudioOnly: Occurs when the subscribed video stream falls back to audio-only stream due to weak network conditions or switches back to the video stream after the network conditions improve.
- setPlayerOptionInInt and setPlayerOptionInString: Sets media player options for providing technical previews or special customization features.
- enableCustomAudioLocalPlayback: Sets whether to enable the local playback of external audio source.
Improvements
-
SDK task processing scheduling optimization
This release optimizes the scheduling mechanism for internal tasks within the SDK, with improvements in the following aspects:
- The speed of video rendering and audio playback for both remote and local first frames improves by 10% to 20%.
- The API call duration and response time are reduced by 5% to 50%.
- The SDK's parallel processing capability significantly improves, delivering higher video quality (720P, 24 fps) even on lower-end devices. Additionally, image processing remains more stable in use-cases involving high resolutions and frame rates.
- The stability of the SDK is further enhanced, leading to a noticeable decrease in the crash rate across various specific use-cases.
-
In-ear monitoring volume boost
This release provides users with more flexible in-ear monitoring audio adjustment options, supporting the ability to set the in-ear monitoring volume to four times the original volume by calling setInEarMonitoringVolume.
-
Spatial audio effects usability improvement
- This release optimizes the design of the setZones method, supporting the ability to set the
zonesparameter toNULL, indicating the clearing of all echo cancellation zones. - As of this release, it is no longer necessary to unsubscribe from the audio streams of all remote users within the channel before calling the ILocalSpatialAudioEngine method.
- This release optimizes the design of the setZones method, supporting the ability to set the
-
Other Improvements
This release also includes the following improvements:
- This release optimizes the SDK's domain name resolution strategy, improving the stability of calling to resolve domain names in complex network environments.
- When passing in an image with transparent background as the virtual background image, the transparent background can be filled with customized color.
- This release adds the
earMonitorDelayandaecEstimatedDelaymembers in LocalAudioStats to report ear monitor delay and acoustic echo cancellation (AEC) delay, respectively. - The onPlayerCacheStats callback is added to report the statistics of the media file being cached. This callback is triggered once per second after file caching is started.
- The onPlayerPlaybackStats callback is added to report the statistics of the media file being played. This callback is triggered once per second after the media file starts playing. You can obtain information like the audio and video bitrate of the media file through PlayerPlaybackStats.
Issues fixed
This release fixed the following issue:
- When sharing two screen sharing video streams simultaneously, the reported
captureFrameRatein the onLocalVideoStats callback is 0, which is not as expected.
API changes
Added
- enableCustomAudioLocalPlayback
- queryDeviceScore
- The
CustomVideoSourceenumeration in MediaSourceType - The
RouteBluetoothDeviceA2DPenumeration in AudioRoute - LocalAudioStats: Adds the
earMonitorDelayandaecEstimatedDelay - selectMultiAudioTrack
- onPlayerCacheStats
- onPlayerPlaybackStats
- PlayerPlaybackStats
Modified
routeBluetoothis renamed asRouteBluetoothDeviceHFP- All
ERRORfields in the following enumerations are changed toREASON:LocalAudioStreamErrorOkLocalAudioStreamErrorFailureLocalAudioStreamErrorDeviceNoPermissionLocalAudioStreamErrorDeviceBusyLocalAudioStreamErrorRecordFailureLocalAudioStreamErrorEncodeFailureLocalVideoStreamErrorOkLocalVideoStreamErrorFailureLocalVideoStreamErrorDeviceNoPermissionLocalVideoStreamErrorDeviceBusyLocalVideoStreamErrorCaptureFailureLocalVideoStreamErrorCodecNotSupportLocalVideoStreamErrorCaptureInbackground(iOS)LocalVideoStreamErrorCaptureMultipleForegroundApps(iOS)LocalVideoStreamErrorDeviceNotFoundLocalVideoStreamErrorDeviceDisconnectedLocalVideoStreamErrorDeviceInvalidIdDirectCdnStreamingErrorOkDirectCdnStreamingErrorFailedDirectCdnStreamingErrorAudioPublicationDirectCdnStreamingErrorVideoPublicationDirectCdnStreamingErrorNetConnectDirectCdnStreamingErrorBadNamePlayerErrorNonePlayerErrorInvalidArgumentsPlayerErrorInternalPlayerErrorNoResourcePlayerErrorInvalidMediaSourcePlayerErrorUnknownStreamTypePlayerErrorObjNotInitializedPlayerErrorCodecNotSupportedPlayerErrorVideoRenderFailedPlayerErrorInvalidStatePlayerErrorUrlNotFoundPlayerErrorInvalidConnectionStatePlayerErrorSrcBufferUnderflowPlayerErrorInterruptedPlayerErrorNotSupportedPlayerErrorTokenExpiredPlayerErrorUnknownRtmpStreamPublishErrorOkRtmpStreamPublishErrorInvalidArgumentRtmpStreamPublishErrorEncryptedStreamNotAllowedRtmpStreamPublishErrorConnectionTimeoutRtmpStreamPublishErrorInternalServerErrorRtmpStreamPublishErrorRtmpServerErrorRtmpStreamPublishErrorTooOftenRtmpStreamPublishErrorReachLimitRtmpStreamPublishErrorNotAuthorizedRtmpStreamPublishErrorStreamNotFoundRtmpStreamPublishErrorFormatNotSupportedRtmpStreamPublishErrorNotBroadcasterRtmpStreamPublishErrorTranscodingNoMixStreamRtmpStreamPublishErrorNetDownRtmpStreamPublishErrorInvalidPrivilegeRtmpStreamUnpublishErrorOk
Deleted
startChannelMediaRelayupdateChannelMediaRelaystartChannelMediaRelayExupdateChannelMediaRelayExonChannelMediaRelayEventChannelMediaRelayEvent
v4.2.6
v4.2.6 was released on November 24, 2023.
Issues fixed
This release fixed the following issue:
- When using an iOS 16 or later device with Bluetooth headphones connected before joining the channel, the audio routing after joining the channel was not as expected: Audio was played from the speaker, not the Bluetooth headphones (iOS).
v4.2.5
v4.2.5 was released on October 31, 2023.
Issues fixed
This release fixed an incorrect path in the types field in package.json, which caused the error Could not find a declaration file for module 'react-native-agora' when integrating the SDK into a TypeScript project.
v4.2.4
v4.2.4 was released on October 25, 2023.
Issues fixed
This release fixes the following issue:
The AgoraRtcWrapper version number in CFBundleShortVersionString on iOS is wrong, which interferes with submitting the App to the App Store.
v4.2.3
v4.2.3 was released on October 20, 2023.
New features
-
Wildcard token
This release introduces wildcard tokens. Agora supports setting the channel name used for generating a token as a wildcard character. The token generated can be used to join any channel if you use the same user ID. In use-cases involving multiple channels, such as switching between different channels, using a wildcard token can prevent repeated application of tokens every time users join a new channel, which reduces the pressure on your token server.
All 4.x SDKs support using wildcard tokens.
-
Preloading channels
This release adds
preloadChannelandpreloadChannelWithUserAccountmethods, which allow a user whose role is set as audience to preload channels before joining one. Calling the method can help shorten the time of joining a channel, thus reducing the time it takes for audience members to hear and see the host.When preloading more than one channel, Agora recommends that you use a wildcard token for preloading to avoid repeated application of tokens every time you join a new channel, thus saving the time for switching between channels.
Improvements
This release includes the following improvements:
- Optimizes the logic of handling invalid parameters. When you call the
setPlaybackSpeedmethod to set the playback speed of audio files, if you pass an invalid parameter, the SDK returns the error code-2, which means that you need to reset the parameter. - Optimizes the logic of Token parsing, in order to prevent an app from crashing when an invalid token is passed in.
- To improve the switching experience between multiple audio routes on Android, this release adds the
setRouteInCommunicationModemethod. This method can switch the audio route from a Bluetooth headphone to the earpiece, wired headphone or speaker in communication volume mode (MODE_IN_COMMUNICATION).
Issues fixed
This release fixed the following issues:
- Occasional failure of joining a channel when the local system time was not set correctly.
- When calling the
playEffectmethod to play two audio files using the samesoundId, the first audio file was sometimes played repeatedly. - When the host called the
startAudioMixingmethod to play music on Android, sometimes the host couldn't hear the music while the remote users could. - Occasional crashes on certain Android devices.
- In channels joined by calling
joinChannelExexclusively on Android, callingsetEnableSpeakerphonedid not result in switching the audio route from the speaker to the headphone. - Occasionally, noise occurred when the local user listened to their own and remote audio after joining the channel on macOS.
- Slow channel reconnection after the connection was interrupted due to network reasons.
API changes
Added
enableContentInspectExcontentInspectImageModerationinContentInspectTypeserverConfiginContentInspectConfigisFeatureAvailableOnDeviceFeatureTypesetCameraExposureFactorisCameraExposureSupportedpreloadChannelpreloadChannelWithUserAccountupdatePreloadChannelTokensetRouteInCommunicationMode(Android)CodecCapLevelsVideoCodecCapabilityLevelbackgroundColorinVideoCanvascodecLevelsinCodecCapInforemoteVideoStateReasonCodecNotSupportinRemoteVideoStateReason
v4.2.1
This version was released on June 21, 2023.
Improvements
This version improves the network transmission strategy, enhancing the smoothness of audio interactions.
Issues fixed
This version fixed the following issues:
- Inability to join channels caused by SDK's incompatibility with some older versions of AccessToken.
- After the sending end called
setAINSModeto activate AI noise reduction, occasional echo was observed by the receiving end. - Brief noise occurred while playing media files using the media player.
- occasional crash after calling the
destroyMediaPlayermethod. (iOS)
v4.2.0
v4.2.0 was released on May 29, 2023.
Compatibility changes
If you use the features mentioned in this section, ensure that you modify the implementation of the relevant features after upgrading the SDK.
1. Channel media options
publishCustomAudioTrackEnableAecis deleted. UsepublishCustomAudioTrackinstead.publishCustomAudioSourceIdis renamed topublishCustomAudioTrackId.
2. Miscellaneous
onApiCallExecutedis deleted. Agora recommends getting the results of the API implementation through relevant channels and media callbacks.- The
IAudioFrameObserverclass is renamed toIAudioPcmFrameSink, thus the prototype of theonFramemethod is updated accordingly. startChannelMediaRelay,updateChannelMediaRelay,startChannelMediaRelayEx, andupdateChannelMediaRelayExare deprecated. UsestartOrUpdateChannelMediaRelayandstartOrUpdateChannelMediaRelayExinstead.
New features
AI Noise Suppression
This release introduces public APIs for the AI Noise Suppression function. Once enabled, the SDK automatically detects and reduces background noises. Whether in bustling public venues or real-time competitive arenas that demand lightning-fast responsiveness, this function guarantees optimal audio clarity, providing users with an elevated audio experience. You can enable this function through the newly-introduced setAINSMode method and set the noise reduction mode as balance, aggressive, or low latency according to your use-case.
Agora charges separately for this function. See AI Noise Suppression unit pricing.
Improvements
1. Voice changer
This release introduces the setLocalVoiceFormant method that allows you to adjust the formant ratio to change the timbre of the voice. This method can be used together with the setLocalVoicePitch method to adjust the pitch and timbre of voice at the same time, enabling a wider range of voice transformation effects.
2. Improved compatibility with audio file types (Android)
As of v4.2.0, you can use the following methods to open files with a URI starting with content://:
startAudioMixing,playEffectopenWithMediaSource
3. Channel media relay
This release introduces startOrUpdateChannelMediaRelay and startOrUpdateChannelMediaRelayEx, allowing for a simpler and smoother way to start and update media relay across channels. With these methods, developers can easily start the media relay across channels and update the target channels for media relay with a single method. Additionally, the internal interaction frequency has been optimized, effectively reducing latency in function calls.
4. Custom audio tracks
To better meet the needs of custom audio capture use-cases, this release adds createCustomAudioTrack and destroyCustomAudioTrack for creating and destroying custom audio tracks. Two types of audio tracks are also provided for users to choose from, further improving the flexibility of capturing external audio source:
- Mixable audio track: Supports mixing multiple external audio sources and publishing them to the same channel, suitable for multi-channel audio capture use-cases.
- Direct audio track: Only supports publishing one external audio source to a single channel, suitable for low-latency audio capture use-cases.
Issues fixed
This release fixed the following issues:
- Occasional crashes occurred on Android devices when users joined or left a channel (Android).
- When the host frequently switched the user role between broadcaster and audience in a short period of time, the audience members could not hear the audio of the host.
- Occasional failure when enabling in-ear monitoring (Android).
- Occasional echo (Android).
- Abnormal client status caused by an exception in the
onRemoteAudioStateChangedcallback. - Playing audio files with a sample rate of 48 kHz failed.
- In real-time chorus use-cases, remote users heard noises and echoes when an OPPO R11 device joined the channel in the loudspeaker mode (Android).
- When the playback of the local music finished, the
onAudioMixingFinishedcallback was not properly triggered (Android).
API changes
Added
startOrUpdateChannelMediaRelaystartOrUpdateChannelMediaRelayExgetNtpWallTimeInMsgetCurrentMonotonicTimeInMssetAINSModecreateAudioCustomTrackdestroyAudioCustomTrackAudioTrackConfigAudioAinsModeAudioTrackType- The
domainLimitandautoRegisterAgoraExtensionsmembers inRtcEngineContext
Deprecated
startChannelMediaRelaystartChannelMediaRelayExupdateChannelMediaRelayupdateChannelMediaRelayExonChannelMediaRelayEventChannelMediaRelayEvent
Deleted
onApiCallExecutedpublishCustomAudioTrackEnableAecinChannelMediaOptions
v4.1.0
v4.1.0 was released on December 20, 2022.
New features
1. In-ear monitoring
This release adds support for in-ear monitoring. You can call enableInEarMonitoring to enable the in-ear monitoring function.
To adjust the in-ear monitoring volume, you can call setInEarMonitoringVolume.
2. Audio capture device test (Android)
This release adds support for testing local audio capture devices before joining a channel. You can call startRecordingDeviceTest to start the audio capture device test. After the test is complete, call the stopPlaybackDeviceTest method to stop the audio capture device test.
3. Local network connection types
To make it easier for users to know the connection type of the local network at any stage, this release adds the getNetworkType method. You can use this method to get the type of network connection in use. The available values are UNKNOWN, DISCONNECTED, LAN, WIFI, 2G, 3G, 4G, and 5G. When the local network connection type changes, the SDK triggers the onNetworkTypeChanged callback to report the current network connection type.
4. Audio stream filter
This release introduces filtering audio streams based on volume. Once this function is enabled, the Agora server ranks all audio streams by volume and transports the three audio streams with the highest volumes to the receivers by default. The number of audio streams to be transported can be adjusted; contact support@agora.io to adjust this number according to your use-case.
Agora also supports publishers in choosing whether the audio streams being published are to be filtered based on volume. Streams that are not filtered bypass this filter mechanism and are transported directly to the receivers. In use-cases with a number of publishers, enabling this function helps reduce the bandwidth and device system pressure for the receivers.
5. Spatial audio effect
This release adds the following features applicable to spatial audio effect use-cases, which can effectively enhance the user's sense-of-presence experience in virtual interactive use-cases.
- Sound insulation area: You can set a sound insulation area and sound attenuation parameter by calling
setZones. When the sound source (which can be a user or the media player) and the listener belong to the inside and outside of the sound insulation area, the listener experiences an attenuation effect similar to that of the sound in the real environment when it encounters a building partition. You can also set the sound attenuation parameter for the media player and the user by callingsetPlayerAttenuationandsetRemoteAudioAttenuationrespectively, and specify whether to use that setting to force an override of the sound attenuation parameter insetZones. - Doppler sound: You can enable Doppler sound by setting the
enable_dopplerparameter inSpatialAudioParams. The receiver experiences noticeable tonal changes in the event of a high-speed relative displacement between the source and receiver (such as in a racing game use-case). - Headphone equalizer: You can use a preset headphone equalization effect by calling the
setHeadphoneEQPresetmethod to improve the audio experience for users with headphones. If you cannot achieve the expected headphone EQ effect after callingsetHeadphoneEQPreset, you can callsetHeadphoneEQParametersto adjust the EQ.
6. MPUDP (MultiPath UDP) (Beta)
As of this release, the SDK supports MPUDP protocol, which enables you to connect and use multiple paths to maximize the use of channel resources based on the UDP protocol. You can use different physical NICs on both mobile and desktop and aggregate them to effectively combat network jitter and improve transmission quality.
7. Multi-channel management
This release adds a series of multi-channel-related methods that you can call to manage audio in multi-channel use-cases.
- The
muteLocalAudioStreamExmethod is used to cancel or resume publishing a local audio stream. - The
muteAllRemoteAudioStreamsExis used to cancel or resume the subscription of all remote users to audio. - The
startRtmpStreamWithoutTranscodingEx,startRtmpStreamWithTranscodingEx,updateRtmpTranscodingEx, andstopRtmpStreamExmethods are used to implement Media Push in multi-channel use-cases. - The
startChannelMediaRelayEx,updateChannelMediaRelayEx,pauseAllChannelMediaRelayEx,resumeAllChannelMediaRelayEx, andstopChannelMediaRelayExmethods are used to relay media streams across channels in multi-channel use-cases. - The
optionsparameter in theleaveChannelExmethod is used to choose whether to stop recording with the microphone when leaving a channel in a multi-channel use-case.
Improvements
1. Bluetooth permissions (Android)
To simplify integration, as of this release, you can use the SDK to enable Android users to use Bluetooth normally without adding the BLUETOOTH_CONNECT permission.
2. Relaying media streams across channels
This release optimizes the updateChannelMediaRelay method as follows:
- Before v4.1.0: If the target channel update fails due to internal reasons in the server, the SDK returns the error code
RelayEventPacketUpdateDestChannelRefused (8), and you need to call theupdateChannelMediaRelaymethod again. - v4.1.0 and later: If the target channel update fails due to internal server reasons, the SDK retries the update until the target channel update is successful.
3. Reconstructed AIAEC algorithm
This release reconstructs the AEC algorithm based on the AI method. Compared with the traditional AEC algorithm, the new algorithm can preserve the complete, clear, and smooth near-end vocals under poor echo-to-signal conditions, significantly improving the system's echo cancellation and dual-talk performance. This gives users a more comfortable call and live-broadcast experience. AIAEC is suitable for conference calls, chats, karaoke, and other scenarios.
Other improvements
This release includes the following additional improvements:
- Reduces the latency when pushing external audio sources.
- Improves the performance of echo cancellation when using the
audioScenarioMeetingscenario. - Enhances the ability to identify different network protocol stacks and improves the SDK's access capabilities in multiple-operator network use-cases.
Issues fixed
This release fixes the following issues:
All
The call getExtensionProperty failed and returned an empty string.
Android
- In online meeting use-cases, the local user and the remote user occasionally could not hear each other after the local user was interrupted by a call.
- After calling
setCloudProxyto set the cloud proxy, callingjoinChannelExto join multiple channels failed.
iOS
Calling startAudioMixing to play music files in the ipod-library://item path failed.
API changes
Added
getNativeHandlegetMusicContentCentergetPlaybackDefaultDevicegetRecordingDefaultDevicegetNetworkTypesetZonessetRemoteAudioAttenuationsetHeadphoneEQPresetsetHeadphoneEQParametersHeadphoneEqualizerPresetadjustUserPlaybackSignalVolumeExonRhythmPlayerStateChangedRhythmPlayerStateTypeRhythmPlayerErrorTypeenableAudioVolumeIndicationExmuteLocalAudioStreamExmuteAllRemoteAudioStreamsExstartRtmpStreamWithoutTranscodingExstartRtmpStreamWithTranscodingExupdateRtmpTranscodingExstopRtmpStreamExstartChannelMediaRelayExupdateChannelMediaRelayExpauseAllChannelMediaRelayExresumeAllChannelMediaRelayExstopChannelMediaRelayEx
Modified
- Adds
isAudioFilterableinChannelMediaOptions - Adds
enable_dopplerinSpatialAudioParams - Adds
optionsinleaveChannelEx - Adds
newRoleOptionsinonClientRoleChanged
Deprecated
onApiCallExecuted: Use the callbacks triggered by specific methods instead.RelayEventPacketUpdateDestChannelRefused (8)inChannelMediaRelayEvent
v4.0.0
v4.0.0 was released on September 29, 2022.
Compatibility changes
Integration change
This release has changed the SDK package name from react-native-agora-rtc-ng to react-native-agora, and optimized the implementation of some features, resulting in incompatibility with v3.7.0. The following are the main features with compatibility changes:
- Multiple channel
- Media stream publishing control
- Warning codes
After upgrading the SDK, you need to update the code in your app according to your business use-cases. For details, see Migration guide.
New features
1. Multiple media tracks
This release supports one IRtcEngine instance to collect multiple audio sources at the same time and publish them to the remote users by setting RtcEngineEx and ChannelMediaOptions.
- After calling
joinChannelto join the first channel, calljoinChannelExmultiple times to join multiple channels, and publish the specified stream to different channels through different user ID (localUid) andChannelMediaOptionssettings.
You can also experience the following features with the multi-channel capability:
- Publish multiple sets of audio streams to the remote users through different user IDs (
uid). - Mix multiple audio streams and publish to the remote users through a user ID (
uid).
2. Agora media player
To make it easier for users to integrate the Agora SDK and reduce the SDK's package size, this release introduces the Agora media player. After calling the createMediaPlayer method to create a media player object, you can then call the methods in the IMediaPlayer class to experience a series of functions, such as playing local and online media files, preloading a media file, changing the CDN route for playing according to your network conditions, or sharing the audio streams being played with remote users.
- Plays local and online media files.
- Preloads media files.
- Changes the CDN route for playing media files according your network conditions.
- Shares the audio streams being played with remote users.
- Caches data when playing media files.
3.Brand-new AI Noise Suppression
The SDK supports a new version of AI noise reduction (in comparison to the basic AI noise reduction in v3.7.0). The new AI noise reduction has better vocal fidelity, cleaner noise suppression, and adds a dereverberation option.
NOTE: To experience this feature, contact support@agora.io.
4. Ultra-high audio quality
To make the audio clearer and restore more details, this release adds the UltraHighQualityVoice enumeration. In use-cases that mainly feature the human voice, such as chat or singing, you can call setVoiceBeautifierPreset and use this enumeration to experience ultra-high audio quality.
5. Spatial audio
NOTE: This feature is in experimental status. To enable this feature, contact support@agora.io. Contact technical support if needed.
You can set the spatial audio for the remote user as following:
- Local Cartesian Coordinate System Calculation: This solution uses the
ILocalSpatialAudioEngineclass to implement spatial audio by calculating the spatial coordinates of the remote user. You need to callupdateSelfPositionandupdateRemotePositionto update the spatial coordinates of the local and remote users, respectively, so that the local user can hear the spatial audio effect of the remote user.
You can also set the spatial audio for the media player as following:
- Local Cartesian Coordinate System Calculation: This solution uses the
ILocalSpatialAudioEngineclass to implement spatial audio. You need to callupdateSelfPositionandupdatePlayerPositionInfoto update the spatial coordinates of the local user and media player, respectively, so that the local user can hear the spatial audio effect of media player.
6. Real-time chorus
This release gives real-time chorus the following abilities:
- Two or more choruses are supported.
- Each singer is independent of each other. If one singer fails or quits the chorus, the other singers can continue to sing.
- Very low latency experience. Each singer can hear each other in real time, and the audience can also hear each singer in real time.
This release adds the AudioScenarioChorus enumeration in AudioScenarioType. With this enumeration, users can experience ultra-low latency in real-time chorus when the network conditions are good.
7. Enhanced channel management
To meet the channel management requirements of various business use-cases, this release adds the following functions to the ChannelMediaOptions structure:
- Sets or switches the publishing of multiple audio sources.
- Sets or switches channel profile and user role.
- Controls audio publishing delay.
Set ChannelMediaOptions when calling joinChannel or joinChannelEx to specify the publishing and subscription behavior of a media stream, for example, whether to subscribe to the audio streams of remote users. After joining the channel, call updateChannelMediaOptions to update the settings in ChannelMediaOptions at any time, for example, to switch the published audio sources.
8. Subscription allowlists and blocklists
This release introduces subscription allowlists and blocklists for remote audio streams. You can add a user ID that you want to subscribe to in your allowlist, or add a user ID for the streams you do not wish to see to your blocklists. You can experience this feature through the following APIs, and in use-cases that involve multiple channels, you can call the following methods in the IRtcEngineEx interface:
SetSubscribeAudioBlocklist:Set the audio subscription blocklist.SetSubscribeAudioAllowlist:Set the audio subscription allowlist.
If a user is added in a blocklist and a allowlist at the same time, only the blocklist takes effect.
9. Set audio scenarios
To make it easier to change audio scenarios, this release adds the SetAudioScenario method. For example, if you want to change the audio scenario from AudioScenarioDefault to AudioScenarioGameStreaming when you are in a channel, you can call this method.
Improvements
1. Fast channel switching
This release can achieve the same switching speed as SwitchChannel in v3.7.0 through the LeaveChannel and JoinChannel methods so that you don't need to take the time to call the SwitchChannel method.
2. Voice pitch of the local user
This release adds voicePitch in AudioVolumeInfo of onAudioVolumeIndication. You can use voicePitch to get the local user's voice pitch and perform business functions such as rating for singing.
