In an AI Interactive Classroom, instead of a real teacher, a server-side AI teacher automatically sends pre-recorded educational videos to students.
The whole process of an AI-enabled interactive class is as follows:
Before a class:
- Record key points, questions and answers in video clips based on the curriculum.
- Implement the Agora Media Streaming Server SDK on your server.
During a class:
- The AI teacher on the server pushes video files to students.
- Students view the videos and answer the AI teacher's questions either by clicking the icons on the screen or speaking into the microphone.
- The AI teacher on the server interprets feedback from the students, and acts accordingly.
|Real-time communication||Students can send and receive real-time audio and video data and interact with each other.|
|Real-time messaging||Students can chat with text messages in real time.|
|Sending media files to students||The server sends MP4 files to an Agora channel and generates a playback queue for switching between video clips seamlessly.|
|Noise reduction and audio gain||Agora provides a tool for reducing noise and turning up the audio gain to improve the audio quality of your video files.|
|AI frame interpolation||Agora provides a tool for frame interpolation to ensure smooth switch between the video files.|
|Oral English assessment||Agora provides a sample app that demonstrates how to English spoken words captured by the Agora RTC SDK to a third-party platform for pronunciation assessment.|
Agora provides demos of the AI Interactive Classroom on Android and iOS.
|Download demo||Download demo|
- Integrate the Agora RTC SDK and the Agora RTM SDK to implement real-time interaction by sending and receiving real-time messages, audio and video through the Agora SD-RTN™, an underlying real-time transmission network built by Agora.
- Through the Agora RTC SDK, send the audio stream to the third-party platform for audio recognition and oral English assessment.
AI teacher on the server:
- Obtain the answer data and oral English assessment results from Agora SD-RTN™, and compare them with the answer key for judgement.
- Based on the students' responses, obtain the corresponding video clips from the video library, and push the video clips to the students' clients through the Agora Media Streaming Sever SDK.
1. High-speed and stable real-time data transmission
Agora SD-RTNTM, a self-built real-time audio and video dedicated network, deploys nodes covering more than 200 countries and regions around the world. It particularly optimizes the last-mile transmission in areas such as North America, the Philippines, India, etc. to ensure high concurrency, high availability, high stability, and low latency.
2. Excellent performance under poor network conditions
Agora is dedicated to improving the performance under poor network conditions by intelligently adjusting the bit rate and frame rate, optimizing the end-to-end algorithm, and utilizing the jitter buffer mechanism.
With an industry-leading algorithm designed to minimize the impact of packet loss, Agora guarantees smooth audio and video when the packet loss rate reaches 70%, and smooth audio when the packet loss rate is as high as 80%.
3. AI frame interpolation
Agora provides a tool for inserting frames between two separate video files. By doing this, Agora ensures a seamless and smooth switch between the two video files.
4. High audio quality
Agora provides a tool for reducing the noise in videos recorded in an indoor environment and turning up the audio gain.
Agora SDKs are compatible with more than 6000 devices. Agora optimizes audio and video performance for low-end devices.
6. Quality assurance during and after class
Agora Analytics can be used for tracking and analyzing the usage and quality of classes. You can use this tool to locate quality issues, track down root causes, and fix any problems to improve the final user experience.
API call sequence
Build an AI teacher on a server
Integrate the Agora Media Streaming Server SDK on your server to successfully push media files to an Agora channel.
- A media streaming command-line tool that can push a maximum of three video clips to a specified Agora live-broadcast channel in sequence. For details, see Streaming by Command Line.
- Three preprocessing tools, including:
- mediaConvert: Use this tool to transcode video files and ensure that the format of the video files meets certain requirements. For details, see Use mediaConvert.
- mediaDenoise: Use this tool to reduce the background noise, turn up the audio gain of sound in video files, and change the resolution of output video files. For details, see Use mediaDenoise.
- AIInterpolation: Use this tool to insert frames between two video files. For details, see Use AIInterpolation.
- An Integration guide, which shows you how to integrate the Agora Media Streaming Server SDK into your project and call APIs for media streaming. For details, see Implement Media Streaming on Server.
- The API reference of Agora Media Streaming Server SDK.
Build a client for students
You can download the Agora RTC SDK and follow the steps in the Quick Start to integrate the SDK into your project, and call the APIs to implement basic broadcasting on Android, Windows, iOS and macOS.
|Platform||SDK download||Open-source demo||Integration guide|
|Android||v220.127.116.11||Open Live (Java)||Quick start on Android|
|iOS||v18.104.22.168||Open Live (OC)
Open Live (Swift)
|Quick start on iOS|
|macOS||v22.214.171.124||Open Live (OC)
Open Live (Swift)
|Quick start on macOS|
|Windows||v126.96.36.199||Open Live (C++)||Quick start on Windows|
|Web||Web SDK||Demo (JS)||Quick start on Web|
You can download the Agora RTM SDK and follow the steps in the Quick Start to integrate the SDK into your project, and call the APIs to implement basic real-time messaging on Android, Windows, iOS and macOS.
|Overview||SDK download||Integration guide|
|Real-time message||Agora Real-time Message SDK download||Peer-to-peer or Channel Messaging|
Oral English assessment
Agora provides the following demos that shows how to send the audio captured by the Agora RTC SDK to a third-party platform for oral English assessment.
|Android||Pronunciation Assessment (Android)|
|iOS||Pronunciation Assessment (iOS)|