Agora Launches Conversational AI Engine for Seamless Voice AI Experiences
Agora (NASDAQ: API) has launched its Conversational AI Engine, enabling developers to create interactive voice experiences with any AI model. The solution features ultra-low latency responses and superior voice processing capabilities, allowing seamless integration with custom-built or leading LLM providers' AI models.
Key features include background noise suppression, AI-driven acoustic algorithms, real-time speech-to-text, and dynamic packet loss handling. The engine is built on the TEN framework and will be extended to Agora's App Builder for no-code implementation.
Agora has partnered with Oracle as a key AI infrastructure provider, utilizing Oracle Cloud Infrastructure (OCI) for enhanced performance and security. The engine targets various applications including customer support, IoT integration, virtual shopping, live AI hosting, mental health support, tutoring, gaming, and employee onboarding. The solution is currently available in public beta.
Agora (NASDAQ: API) ha lanciato il suo Motore di Intelligenza Artificiale Conversazionale, consentendo agli sviluppatori di creare esperienze vocali interattive con qualsiasi modello di intelligenza artificiale. La soluzione offre risposte a latenza ultra-bassa e capacità di elaborazione vocale superiori, permettendo un'integrazione fluida con modelli di intelligenza artificiale personalizzati o fornitori di LLM leader.
Le caratteristiche principali includono la soppressione del rumore di fondo, algoritmi acustici guidati dall'AI, riconoscimento vocale in tempo reale e gestione dinamica della perdita di pacchetti. Il motore è costruito sulla piattaforma TEN e sarà esteso all'App Builder di Agora per un'implementazione senza codice.
Agora ha collaborato con Oracle come fornitore chiave di infrastruttura AI, utilizzando l'Oracle Cloud Infrastructure (OCI) per prestazioni e sicurezza migliorate. Il motore mira a varie applicazioni, tra cui supporto clienti, integrazione IoT, shopping virtuale, hosting AI dal vivo, supporto per la salute mentale, tutoraggio, giochi e onboarding dei dipendenti. La soluzione è attualmente disponibile in beta pubblica.
Agora (NASDAQ: API) ha lanzado su Motor de IA Conversacional, permitiendo a los desarrolladores crear experiencias de voz interactivas con cualquier modelo de IA. La solución presenta respuestas de ultra baja latencia y capacidades superiores de procesamiento de voz, permitiendo una integración fluida con modelos de IA personalizados o de proveedores líderes de LLM.
Las características clave incluyen supresión de ruido de fondo, algoritmos acústicos impulsados por IA, conversión de voz a texto en tiempo real y manejo dinámico de la pérdida de paquetes. El motor está construido sobre el marco TEN y se ampliará al App Builder de Agora para una implementación sin código.
Agora se ha asociado con Oracle como proveedor clave de infraestructura de IA, utilizando Oracle Cloud Infrastructure (OCI) para un rendimiento y seguridad mejorados. El motor está dirigido a diversas aplicaciones, incluyendo soporte al cliente, integración de IoT, compras virtuales, alojamiento de IA en vivo, apoyo a la salud mental, tutoría, juegos y la incorporación de empleados. La solución está actualmente disponible en beta pública.
아고라 (NASDAQ: API)는 대화형 AI 엔진을 출시하여 개발자들이 어떤 AI 모델로도 인터랙티브한 음성 경험을 만들 수 있도록 지원합니다. 이 솔루션은 초저지연 응답과 뛰어난 음성 처리 기능을 제공하여 맞춤형 또는 주요 LLM 제공업체의 AI 모델과 원활하게 통합할 수 있습니다.
주요 기능으로는 배경 소음 억제, AI 기반 음향 알고리즘, 실시간 음성 인식 및 동적 패킷 손실 처리 등이 있습니다. 이 엔진은 TEN 프레임워크를 기반으로 구축되었으며, 코드 없는 구현을 위해 Agora의 앱 빌더로 확장될 예정입니다.
아고라는 오라클과 협력하여 주요 AI 인프라 제공업체로 자리 잡았으며, 성능과 보안을 향상시키기 위해 Oracle Cloud Infrastructure (OCI)를 활용하고 있습니다. 이 엔진은 고객 지원, IoT 통합, 가상 쇼핑, 실시간 AI 호스팅, 정신 건강 지원, 튜터링, 게임 및 직원 온보딩 등 다양한 애플리케이션을 대상으로 하고 있습니다. 이 솔루션은 현재 공개 베타로 제공되고 있습니다.
Agora (NASDAQ: API) a lancé son Moteur d'IA Conversationnelle, permettant aux développeurs de créer des expériences vocales interactives avec n'importe quel modèle d'IA. La solution offre des réponses à ultra-basse latence et des capacités de traitement vocal supérieures, permettant une intégration transparente avec des modèles d'IA personnalisés ou des fournisseurs de LLM leaders.
Les fonctionnalités clés incluent la suppression du bruit de fond, des algorithmes acoustiques pilotés par l'IA, la conversion de la parole en texte en temps réel et la gestion dynamique de la perte de paquets. Le moteur est construit sur le cadre TEN et sera étendu à l'App Builder d'Agora pour une mise en œuvre sans code.
Agora s'est associé à Oracle en tant que fournisseur clé d'infrastructure IA, utilisant l'Oracle Cloud Infrastructure (OCI) pour des performances et une sécurité améliorées. Le moteur cible diverses applications, y compris le support client, l'intégration IoT, le shopping virtuel, l'hébergement AI en direct, le soutien à la santé mentale, le tutorat, les jeux et l'intégration des employés. La solution est actuellement disponible en version bêta publique.
Agora (NASDAQ: API) hat seine Konversations-AI-Engine gestartet, die es Entwicklern ermöglicht, interaktive Spracherlebnisse mit jedem AI-Modell zu erstellen. Die Lösung bietet ultra-niedrige Latenzzeiten und überlegene Sprachverarbeitungsfähigkeiten, die eine nahtlose Integration mit maßgeschneiderten oder führenden LLM-Anbietern ermöglichen.
Zu den Hauptmerkmalen gehören Hintergrundgeräuschunterdrückung, KI-gesteuerte akustische Algorithmen, Echtzeit-Spracherkennung und dynamisches Paketverlustmanagement. Die Engine basiert auf dem TEN-Framework und wird in den App Builder von Agora für eine No-Code-Implementierung integriert.
Agora hat mit Oracle als wichtigem Anbieter von AI-Infrastruktur zusammengearbeitet und nutzt die Oracle Cloud Infrastructure (OCI) für verbesserte Leistung und Sicherheit. Die Engine richtet sich an verschiedene Anwendungen, darunter Kundenservice, IoT-Integration, virtuelles Einkaufen, Live-AI-Hosting, Unterstützung für psychische Gesundheit, Nachhilfe, Gaming und Einarbeitung von Mitarbeitern. Die Lösung ist derzeit in der öffentlichen Beta verfügbar.
- Launch of new Conversational AI Engine product expanding service offerings
- Strategic partnership with Oracle for infrastructure optimization
- No-code implementation capability through App Builder integration
- Multiple revenue potential across various business applications
- Product still in beta phase
- Entering highly competitive AI market space
- Dependent on third-party AI models and TTS solutions
Insights
Agora's launch of the Conversational AI Engine represents a strategic product expansion that addresses critical technical barriers in the voice AI market. The product solves two fundamental challenges that have AI voice interactions: ultra-low latency and natural conversation flow.
What makes this offering significant is its positioning as an infrastructure layer rather than a competitive AI model. By creating technology that works with any AI model (custom or commercial) and any text-to-speech solution, Agora establishes itself as an enabler in the AI ecosystem rather than just another competitor. This approach leverages their core expertise in real-time networking while opening new revenue opportunities.
The Oracle partnership adds enterprise credibility and scalability, potentially accelerating adoption among larger clients. Meanwhile, the planned integration with Agora's App Builder indicates a cohesive product strategy aimed at reducing implementation barriers through a no-code approach.
The breadth of applications highlighted—spanning customer service, IoT, retail, healthcare, education, and gaming—suggests a substantial addressable market. By specializing in optimizing voice-based AI interactions rather than developing general-purpose AI, Agora is creating differentiated value in a crowded market.
This product expansion effectively transitions Agora from enabling solely human-to-human engagement to facilitating human-to-AI interactions, potentially opening significant new market opportunities while building on their existing technical infrastructure.
The new solution allows developers to use any AI model to create voice agents optimized for
ultra-low latency and natural conversation flow
Agora's Conversational AI Engine provides developers with the flexibility to use any AI model, whether custom-built or from leading LLM providers, and any text-to-speech (TTS) voice solution for their AI agent. The Engine is designed to optimize real-time conversation flow. It enables faster, low-latency responses and intelligently pauses for interruptions in real time, enabling more natural dialogue with users.
"Most AI models don't yet offer the ability to interact via voice, and those that do haven't optimized the experience," said Tony Zhao, CEO of Agora. "Agora's solution will help drive the adoption of conversational AI by enabling seamless, natural voice interactions. With effortless integration and real-time, voice-driven experiences that have near-zero lag, we are removing barriers and unlocking new possibilities for businesses and end users alike."
With built-in background noise suppression, AI-driven acoustic algorithms, and real-time speech-to-text (STT), Agora's Conversational AI Engine ensures clear and accurate voice interactions in any environment. Powered by Agora's global Software-Defined Real-Time Network™, the Engine dynamically handles packet loss and minimizes latency, delivering exceptional performance across devices and networks. The solution is built on top of the TEN framework, an Agora-supported community project for building conversational AI. The Engine allows businesses to deploy natural and engaging real-time voice agents with maximum scalability and minimal effort.
Agora also plans to extend the capabilities of the Conversational AI Engine to its App Builder product, enabling a no-code approach to creating conversational AI experiences. App Builder allows users to create a simple UI and seamlessly integrate Agora's Conversational AI Engine without extensive coding, making it possible to deploy voice-driven AI experiences even more quickly.
Zhao continued, "Our goal is to bridge the gap between AI and human interaction, making conversations more intuitive, expressive, and impactful. We are dedicated to democratizing voice interactions between humans and AI models, making them a fundamental part of how people connect, communicate, and innovate."
To further enhance its Conversational AI Engine, Agora is partnering with Oracle as a key AI infrastructure provider, leveraging the scalable Oracle Cloud Infrastructure (OCI) solution to optimize performance, security, and efficiency.
"Agora's Conversational AI Engine solves two of the biggest hurdles in human-to-AI voice conversation—latency and wireless last mile challenges," said Hua Jiang, Alliance & Channel Director, Oracle APAC. "We are proud to collaborate with Agora to provide the infrastructure that enables more natural, responsive, and reliable voice-powered conversational AI."
Agora's Conversational AI Engine is designed for a wide range of applications, including:
- 24/7 Customer Support: Create AI-powered voice agents that provide instant responses, troubleshoot issues, and guide customers through processes.
- IoT Integration: Enable seamless voice control for smart devices, wearables, robots, and connected applications.
- Virtual Shopping Assistants: Help customers find products, compare options, and make purchasing decisions in real time.
- Live AI Hosts: Leverage AI agents to host live events, equipped with automated content moderation and the ability to respond to viewers in real time.
- Mental Health Support: Offer mental health support agents that can listen, provide advice, and connect users with professional help if needed.
- Live Tutoring: Offer AI tutoring that can speak with students to offer real-time feedback and guidance when learning specific languages or subjects.
- AI-Powered NPCs in Gaming: Build more immersive virtual worlds with AI-controlled characters that can interact naturally with players via voice.
- Employee Onboarding: Guide new hires through training and provide instant access to a 24/7 resource to answer questions.
Agora's Conversational AI Engine is now available in public beta, allowing businesses and developers to start building advanced voice AI applications today. For more information, visit www.agora.io/en/products/conversational-ai-engine/.
About Agora
Agora is the global leader in real-time engagement, providing developers with simple, flexible, and powerful APIs to embed real-time conversational AI, voice, video, interactive live streaming, and chat into their applications and IoT devices. Headquartered in
View original content to download multimedia:https://www.prnewswire.com/news-releases/agora-launches-conversational-ai-engine-for-seamless-voice-ai-experiences-302392560.html
SOURCE Agora
FAQ
What is Agora's new Conversational AI Engine and how does it work?
How will Agora's partnership with Oracle benefit the Conversational AI Engine?
What are the main applications for Agora's Conversational AI Engine?
When will Agora's Conversational AI Engine be available?
How does Agora's AI Engine handle voice processing and latency?
