Modal Labs Selects Oracle as its Cloud Infrastructure Provider of Choice
Modal Labs, a serverless platform for AI, ML, and data developers, has chosen Oracle Cloud Infrastructure (OCI) as its primary cloud provider. This partnership enables Modal to deliver faster, more cost-effective AI services to its customers. By leveraging OCI's bare metal compute instances, Modal has achieved significant improvements in performance for inferencing, fine-tuning, and batch processing workloads.
The collaboration allows Modal's customers to scale up to hundreds of nodes and down to zero within seconds, paying only for what they use. OCI's AI infrastructure provides high-tier performance and value across Oracle's distributed cloud, enabling organizations to deploy AI infrastructure wherever needed. This solution addresses common challenges in AI deployment, such as lack of technology infrastructure and GPU availability, which often lead to production losses and higher costs.
Modal Labs, una piattaforma serverless per sviluppatori di AI, ML e dati, ha scelto Oracle Cloud Infrastructure (OCI) come suo principale fornitore di cloud. Questa partnership consente a Modal di offrire servizi AI più rapidi e convenienti ai suoi clienti. Sfruttando le istanze compute bare metal di OCI, Modal ha ottenuto miglioramenti significativi nelle prestazioni per l'inferenza, il fine-tuning e i carichi di lavoro di elaborazione batch.
La collaborazione consente ai clienti di Modal di scalare fino a centinaia di nodi e ridurre fino a zero in pochi secondi, pagando solo per ciò che utilizzano. L'infrastruttura AI di OCI fornisce prestazioni di alto livello e valore attraverso il cloud distribuito di Oracle, consentendo alle organizzazioni di implementare l'infrastruttura AI ovunque sia necessario. Questa soluzione affronta le sfide comuni nella distribuzione dell'AI, come la mancanza di infrastrutture tecnologiche e disponibilità di GPU, che spesso portano a perdite in produzione e costi più elevati.
Modal Labs, una plataforma sin servidor para desarrolladores de AI, ML y datos, ha elegido Oracle Cloud Infrastructure (OCI) como su proveedor principal de nube. Esta asociación permite a Modal ofrecer servicios de AI más rápidos y rentables a sus clientes. Al aprovechar las instancias de computación bare metal de OCI, Modal ha logrado mejoras significativas en el rendimiento para la inferencia, el ajuste fino y las cargas de trabajo de procesamiento por lotes.
La colaboración permite a los clientes de Modal escalar hasta cientos de nodos y reducir a cero en segundos, pagando solo por lo que utilizan. La infraestructura de AI de OCI proporciona un rendimiento y valor de alto nivel en la nube distribuida de Oracle, permitiendo a las organizaciones implementar la infraestructura de AI donde sea necesario. Esta solución aborda los desafíos comunes en la implementación de AI, como la falta de infraestructura tecnológica y disponibilidad de GPU, que a menudo conducen a pérdidas en producción y costos más altos.
Modal Labs는 AI, ML 및 데이터 개발자를 위한 서버리스 플랫폼으로 Oracle Cloud Infrastructure (OCI)를 주요 클라우드 제공업체로 선택했습니다. 이 파트너십을 통해 Modal은 고객에게 더 빠르고 비용 효율적인 AI 서비스를 제공할 수 있게 되었습니다. OCI의 베어 메탈 컴퓨팅 인스턴스를 활용하여 Modal은 추론, 미세 조정 및 배치 처리 작업의 성능을 크게 개선했습니다.
이번 협업은 Modal의 고객이 몇 초 만에 수백 개의 노드로 확장하거나 제로로 줄일 수 있게 해주며, 사용한 만큼만 비용을 지불하게 됩니다. OCI의 AI 인프라는 Oracle의 분산 클라우드 전반에 걸쳐 높은 성능과 가치를 제공하여 조직이 필요한 곳에 AI 인프라를 배포할 수 있도록 지원합니다. 이 솔루션은 AI 배포에서 일반적으로 발생하는 기술 인프라 부족 및 GPU 가용성과 같은 문제를 해결하여 생산 손실 및 더 높은 비용을 초래할 수 있습니다.
Modal Labs, une plateforme sans serveur pour les développeurs d'IA, de ML et de données, a choisi Oracle Cloud Infrastructure (OCI) comme principal fournisseur de cloud. Ce partenariat permet à Modal de proposer des services d'IA plus rapides et plus rentables à ses clients. En tirant parti des instances de calcul bare metal d'OCI, Modal a réalisé des améliorations significatives des performances pour l'inférence, le réglage fin et les charges de travail de traitement par lots.
La collaboration permet aux clients de Modal de monter jusqu'à des centaines de nœuds et de descendre à zéro en quelques secondes, ne payant que pour ce qu'ils utilisent. L'infrastructure d'IA d'OCI offre des performances de haut niveau et de la valeur à travers le cloud distribué d'Oracle, permettant aux organisations de déployer l'infrastructure d'IA partout où cela est nécessaire. Cette solution aborde les défis courants dans le déploiement de l'IA, tels que le manque d'infrastructures technologiques et de disponibilité de GPU, qui entraînent souvent des pertes de production et des coûts plus élevés.
Modal Labs, eine serverlose Plattform für Entwickler von KI, ML und Daten, hat Oracle Cloud Infrastructure (OCI) als seinen Haupt-Cloud-Anbieter gewählt. Diese Partnerschaft ermöglicht es Modal, schnellere und kostengünstigere KI-Dienste für ihre Kunden bereitzustellen. Durch die Nutzung der Bare-Metal-Compute-Instanzen von OCI hat Modal signifikante Leistungsverbesserungen bei Inferenz, Fine-Tuning und Batch-Verarbeitungs-Workloads erzielt.
Die Zusammenarbeit ermöglicht es den Kunden von Modal, innerhalb von Sekunden auf Hunderte von Knoten hoch- oder auf null zu skalieren und nur für das zu zahlen, was sie nutzen. Die KI-Infrastruktur von OCI bietet erstklassige Leistung und Wert über das verteilte Cloud-Angebot von Oracle hinweg, wodurch Organisationen die KI-Infrastruktur überall dort bereitstellen können, wo sie benötigt wird. Diese Lösung adressiert gängige Herausforderungen bei der KI-Bereitstellung, wie Mangel an technologischer Infrastruktur und GPU-Verfügbarkeit, die häufig zu Produktionsverlusten und höheren Kosten führen.
- Modal Labs reports significant performance improvements after shifting workloads to OCI
- OCI enables Modal's customers to scale up to hundreds of nodes within seconds, improving flexibility
- Partnership addresses GPU availability issues, potentially reducing costs for AI deployments
- OCI's bare metal GPU instances support demanding AI applications like natural language processing and computer vision
- None.
Insights
Modal Labs' choice of Oracle Cloud Infrastructure (OCI) for AI workloads signifies a significant shift in the cloud computing landscape. This partnership highlights OCI's growing competitiveness in the AI infrastructure market, traditionally dominated by other major cloud providers.
The key takeaway is OCI's price-performance advantage, particularly for GPU-intensive tasks. This could potentially disrupt the market, forcing other providers to reassess their pricing strategies. For investors, this signals Oracle's strong positioning in the lucrative AI infrastructure sector, which is important for future growth.
However, it's important to note that while this partnership is promising, Oracle still faces stiff competition from established players. The real test will be whether Oracle can attract more high-profile AI companies and expand its market share in this rapidly evolving sector.
This partnership has positive implications for Oracle's financial outlook. By securing Modal Labs as a customer, Oracle demonstrates its ability to compete in the high-growth AI infrastructure market. This could lead to increased revenue streams from AI-focused clients and potentially higher profit margins due to the premium nature of AI services.
Investors should pay attention to Oracle's cloud segment performance in upcoming earnings reports. If this partnership translates into substantial revenue growth or market share gains in the cloud sector, it could positively impact Oracle's stock valuation. However, it's important to monitor whether this success can be replicated with other AI companies and if it significantly contributes to Oracle's overall financial performance.
While promising, this single partnership may not immediately move the needle for a company of Oracle's size. Long-term investors should watch for a trend of similar partnerships and growing AI-related revenue.
AI innovator leverages Oracle Cloud Infrastructure to serve low-latency, real-time production AI workloads at scale
"OCI provides the scale and performance we need to run large AI workloads faster, without incurring excessive compute costs," said Erik Bernhardsson, founder and CEO, Modal. "Oracle is hard to beat when it comes to price, performance, and the level of support it provides. With Modal on OCI, our customers can scale up hundreds of nodes and down to zero within seconds, while only paying for what they use and reducing their reliance on fragmented solutions."
Modal accelerates the development and deployment of AI models by allowing data and engineering teams to run code in the cloud without having to configure or set up the necessary infrastructure. Modal provides developers that are using generative AI to create new applications, such as those used to compose music or design novel protein structures, a platform that delivers fast and reliable GPUs. With OCI, developers building on Modal can ship code, get their data and AI models into production, and test applications at a much faster speed. Modal uses OCI's bare metal compute instances to meet the varying demands of developers building on Modal. By shifting its workloads to OCI, Modal has seen drastic improvements in performance.
"A lack of technology infrastructure and GPU availability often leads to a loss in production and higher costs for organizations trying to deploy AI," said Mahesh Thiagarajan, executive vice president, Oracle Cloud Infrastructure. "OCI AI infrastructure provides the highest-tier performance and value for all AI workloads across Oracle's distributed cloud, so customers can easily deploy AI infrastructure wherever they need it."
OCI AI infrastructure delivers capabilities to accelerate AI deployments
AI innovators like Modal are leveraging OCI's purpose-built AI capabilities to run the most demanding AI workloads faster and more reliably. OCI bare metal GPU instances can power applications including natural language processing, computer vision, and recommendation systems. Oracle's dedicated engineering support team works with customers from planning to launch to help ensure success.
Additional Resources
- Learn more about OCI AI infrastructure
- Learn more about accelerating GPU workloads
- Learn more about the OCI AI ISV Ecosystem
- Read more about Modal's journey with OCI
About Oracle
Oracle offers integrated suites of applications plus secure, autonomous infrastructure in the Oracle Cloud. For more information about Oracle (NYSE: ORCL), please visit us at www.oracle.com.
About Oracle CloudWorld
CloudWorld is where our customers and partners can see the latest innovations in cloud technology, discover methods for getting the most business value from AI today, and explore ways to increase productivity and efficiency through automation. You'll learn from experts and your peers who build and use the applications, cloud infrastructure, databases, developer tools, and AI services that help solve complex business challenges in every industry. Join us to develop new skills and see new capabilities in action. Register now at oracle.com/cloudworld or follow the news and conversation at oracle.com/news and https://www.linkedin.com/company/oracle/
Trademarks
Oracle, Java, MySQL and NetSuite are registered trademarks of Oracle Corporation. NetSuite was the first cloud company—ushering in the new era of cloud computing.
View original content to download multimedia:https://www.prnewswire.com/news-releases/modal-labs-selects-oracle-as-its-cloud-infrastructure-provider-of-choice-302242988.html
SOURCE Oracle
FAQ
What benefits does Modal Labs gain from using Oracle Cloud Infrastructure (ORCL)?
How does Oracle Cloud Infrastructure (ORCL) address AI deployment challenges?
What types of AI applications can Oracle Cloud Infrastructure (ORCL) support?