Agora launches Adaptive Video Optimisation
May 1, 2024
Agora, a platform for real-time engagement APIs, has unveiled its latest innovation, Adaptive Video Optimisation (AVO) along with support for the AV1 video codec. This advanced technology harnesses the power of machine learning to dynamically adjust parameters at every step from capture to playback to deliver an enhanced live video streaming experience.
In today’s fast-paced digital world, live video calling and streaming often encounters hurdles such as unstable network conditions, packet loss, and limited bandwidth. These challenges can result in freezing, stuttering, grainy video, and dropped connections, diminishing the real-time video experience and negatively impacting user engagement. AVO uses a series of advanced machine learning algorithms to address these common issues. By optimising video quality in real time based on network conditions, device capabilities, and available bandwidth, AVO ensures the highest possible video quality possible optimal performance even under varying network scenarios.
“Reliable and high-quality live streaming is essential in today’s video-dominated media landscape,” stated Tony Zhao, CEO and Co-Founder of Agora. “Our Adaptive Video Optimisation technology enables smooth delivery of every call and livestream – despite network variability, user’s location or device. These improvements increase engagement and empower Agora’s customers to provide the highest-quality live video user experience.”
Agora’s commitment to delivering a seamless real-time video experience rests on three core pillars which are fundamental to powering the engaging video experiences delivered by AVO:
- Optimised Image Quality: Ensures that every frame is crisp, with enhanced contrast and vibrant details that make the viewing experience clearer and more engaging.
- Unmatched Video Fluency: Eliminates common streaming issues like buffering and stuttering, providing a smooth and natural flow.
- Ultra-Low Latency: Allows users to interact in real-time, whether with hosts or other viewers, and enjoy quick loading times and instant first-frame rendering for seamless transitions between video streams.
AVO takes a comprehensive machine learning approach to ensure the highest quality video streaming experience by optimising every stage of the video processing pipeline — pre-processing, encoding, transmission, decoding, and post-processing. A key component of this solution is Agora’s Coding Technology (ACT), designed to optimize user experiences by supporting advanced video codecs like AV1 and VP9 and dynamically switching to the codec most suitable for an exceptional video experience despite device limitations or streaming constraints. By employing advanced techniques and cutting-edge compression methods, the technology adapts, configuring parameters dynamically and ensures crisp visuals, efficient bandwidth utilisation, and a consistent, high-quality experience for all users, from the moment the video is captured to the final display on the viewer’s screen.
From video capture through playback, the technology continuously adapts to changing network conditions and device capabilities, guaranteeing a seamless streaming experience. Any imperfections that may arise during transmission are rapidly mitigated, and the final video is polished to provide lifelike clarity, delivering a superior streaming experience that benefits both content creators and viewers.
“Agora’s Adaptive Video Optimisation (AVO) drastically improved the real-time video experience in our app,” said Ellard Capiral, VP of Engineering, KUMU. “Users get smooth, high-quality video without freezes – even on slow connections and older devices. Since implementing AVO, we’ve seen a 30 per cent increase in session length and engagement.”