Confluent and Databricks Partner to Usher In New Age of Real-Time AI
Confluent (NASDAQ:CFLT) and Databricks announced a major partnership expansion to integrate their data streaming and intelligence platforms, enabling real-time AI-driven decision-making for enterprises. The partnership addresses a critical challenge where only 22% of enterprises feel confident their IT infrastructure can support new AI applications.
The collaboration introduces new integrations between Confluent's Tableflow and Databricks' Unity Catalog, providing bidirectional integration with Delta Lake. This integration ensures consistent, real-time data governance across operational and analytical systems. Delta Lake, processing over 10 exabytes of data daily, will now be more accessible through Tableflow, allowing enterprises to use various AI tools and engines.
The partnership enables automated metadata application, making operational data discoverable for data scientists while ensuring analytical data remains accessible for developers. Confluent's Stream Governance suite will enhance governance, lineage tracking, and data quality monitoring in Unity Catalog.
Confluent (NASDAQ:CFLT) e Databricks hanno annunciato una significativa espansione della loro partnership per integrare le loro piattaforme di streaming e intelligenza dei dati, consentendo decisioni aziendali in tempo reale basate sull'AI. Questa collaborazione affronta una sfida critica poiché solo il 22% delle aziende si sente sicuro che la propria infrastruttura IT possa supportare nuove applicazioni di AI.
La collaborazione introduce nuove integrazioni tra Tableflow di Confluent e Unity Catalog di Databricks, fornendo integrazione bidirezionale con Delta Lake. Questa integrazione assicura una governance dei dati coerente e in tempo reale attraverso sistemi operativi e analitici. Delta Lake, che elabora oltre 10 exabyte di dati al giorno, sarà ora più accessibile tramite Tableflow, consentendo alle aziende di utilizzare vari strumenti e motori di AI.
La partnership consente l'applicazione automatizzata dei metadati, rendendo i dati operativi facilmente ricercabili per i data scientist, assicurando al contempo che i dati analitici rimangano accessibili per gli sviluppatori. La suite di governance dello streaming di Confluent migliorerà la governance, il tracciamento della linea temporale e il monitoraggio della qualità dei dati in Unity Catalog.
Confluent (NASDAQ:CFLT) y Databricks anunciaron una importante expansión de su asociación para integrar sus plataformas de transmisión de datos e inteligencia, lo que permite la toma de decisiones empresariales en tiempo real impulsadas por IA. La asociación aborda un desafío crítico, ya que solo el 22% de las empresas se siente seguro de que su infraestructura de TI puede soportar nuevas aplicaciones de IA.
La colaboración introduce nuevas integraciones entre Tableflow de Confluent y Unity Catalog de Databricks, proporcionando integración bidireccional con Delta Lake. Esta integración garantiza una gobernanza de datos coherente y en tiempo real en sistemas operativos y analíticos. Delta Lake, que procesa más de 10 exabytes de datos diarios, ahora será más accesible a través de Tableflow, permitiendo a las empresas utilizar diversas herramientas y motores de IA.
La asociación permite la aplicación automatizada de metadatos, haciendo que los datos operativos sean descubribles para los científicos de datos, asegurando al mismo tiempo que los datos analíticos permanezcan accesibles para los desarrolladores. La suite de gobernanza de streaming de Confluent mejorará la gobernanza, el seguimiento de linajes y la monitorización de la calidad de los datos en Unity Catalog.
Confluent (NASDAQ:CFLT)와 Databricks는 데이터 스트리밍 및 지능 플랫폼을 통합하기 위해 주요 파트너십을 확장한다고 발표했습니다. 이를 통해 기업이 실시간 AI 기반 의사 결정을 내릴 수 있게 됩니다. 이 파트너십은 단지 22%의 기업만이 IT 인프라가 새로운 AI 애플리케이션을 지원할 수 있다고 느끼고 있다는 중요한 문제를 다루고 있습니다.
이번 협업은 Confluent의 Tableflow와 Databricks의 Unity Catalog 간의 새로운 통합을 도입하여 Delta Lake와의 양방향 통합을 제공합니다. 이 통합은 운영 시스템과 분석 시스템 간의 일관된 실시간 데이터 거버넌스를 보장합니다. Delta Lake는 매일 10엑사바이트 이상의 데이터를 처리하며, 이제 Tableflow를 통해 더 접근하기 쉬워져 기업들이 다양한 AI 도구와 엔진을 활용할 수 있습니다.
이 파트너십은 자동화된 메타데이터 적용을 가능하게 하여 운영 데이터가 데이터 과학자에게 쉽게 발견될 수 있도록 하며, 분석 데이터는 개발자가 계속 접근할 수 있도록 보장합니다. Confluent의 스트림 거버넌스 제품군은 Unity Catalog에서 거버넌스, 라인 추적 및 데이터 품질 모니터링을 향상시킬 것입니다.
Confluent (NASDAQ:CFLT) et Databricks ont annoncé une expansion majeure de leur partenariat pour intégrer leurs plateformes de streaming de données et d'intelligence, permettant aux entreprises de prendre des décisions basées sur l'IA en temps réel. Ce partenariat répond à un défi critique, puisqu'à peine 22 % des entreprises se disent confiantes que leur infrastructure informatique peut soutenir de nouvelles applications d'IA.
Cette collaboration introduit de nouvelles intégrations entre Tableflow de Confluent et Unity Catalog de Databricks, offrant une intégration bidirectionnelle avec Delta Lake. Cette intégration garantit une gouvernance des données cohérente et en temps réel à travers des systèmes opérationnels et analytiques. Delta Lake, qui traite plus de 10 exaoctets de données par jour, sera désormais plus accessible via Tableflow, permettant aux entreprises d'utiliser divers outils et moteurs d'IA.
Cette collaboration permet l'application automatisée des métadonnées, rendant les données opérationnelles accessibles pour les data scientists tout en veillant à ce que les données analytiques demeurent accessibles pour les développeurs. La suite de gouvernance de streaming de Confluent améliorera la gouvernance, le suivi des origines et le contrôle de la qualité des données dans Unity Catalog.
Confluent (NASDAQ:CFLT) und Databricks haben eine bedeutende Erweiterung ihrer Partnerschaft angekündigt, um ihre Datenstreaming- und Intelligenzplattformen zu integrieren, was es Unternehmen ermöglicht, auf KI basierende Entscheidungen in Echtzeit zu treffen. Diese Partnerschaft adressiert eine kritische Herausforderung, da nur 22% der Unternehmen zuversichtlich sind, dass ihre IT-Infrastruktur neue KI-Anwendungen unterstützen kann.
Die Zusammenarbeit führt neue Integrationen zwischen Confluents Tableflow und Databricks' Unity Catalog ein, die eine bidirektionale Integration mit Delta Lake bieten. Diese Integration gewährleistet konsistente, Echtzeit-Datengovernance über operative und analytische Systeme hinweg. Delta Lake, das täglich über 10 Exabyte Daten verarbeitet, wird nun über Tableflow zugänglicher, sodass Unternehmen verschiedene KI-Tools und -Engines nutzen können.
Die Partnerschaft ermöglicht die automatisierte Anwendung von Metadaten, sodass operationale Daten für Datenwissenschaftler leicht auffindbar sind, während gleichzeitig sichergestellt wird, dass analytische Daten für Entwickler zugänglich bleiben. Confluents Stream Governance Suite wird die Governance, Nachverfolgung der Herkunft und Datenqualitätsüberwachung im Unity Catalog verbessern.
- Strategic partnership with Databricks enhances real-time AI capabilities
- Integration with Delta Lake platform processing over 10 exabytes of data daily
- New bidirectional integration enables seamless data governance and accessibility
- Enhanced metadata management and stream governance capabilities
- None.
Insights
This strategic partnership between Confluent and Databricks represents a transformative development in the enterprise AI infrastructure landscape, addressing a critical market gap where only 22% of enterprises currently feel equipped to support modern AI applications.
The integration's technical architecture offers three pivotal advantages:
- Bidirectional data flow between Confluent's Tableflow and Delta Lake enables real-time operational data synchronization, significantly reducing latency in AI model training and inference
- Unified governance through Unity Catalog integration streamlines compliance and security protocols across both platforms
- Automated metadata management enhances data discovery and utilization efficiency for both data scientists and application developers
This partnership strategically positions both companies to capture a larger share of the rapidly growing enterprise AI market. For Confluent, it extends their reach beyond traditional data streaming into the AI/ML workflow ecosystem. For Databricks, it strengthens their data lakehouse architecture with robust real-time streaming capabilities, essential for modern AI applications.
The integration's impact extends beyond technical capabilities - it fundamentally changes the economics of enterprise AI implementation. By eliminating the need for custom integration development and reducing data engineering overhead, organizations can accelerate their AI initiatives while optimizing operational costs. The E.ON Digital Technology case study demonstrates the practical benefits, particularly in sectors where real-time data processing is important for competitive advantage.
Looking ahead, this partnership could catalyze increased enterprise AI adoption rates by addressing key technical barriers. The seamless integration between operational and analytical systems, combined with comprehensive governance capabilities, provides a foundation for scalable AI implementation that meets both technical and regulatory requirements.
New partnership eliminates data silos for enterprises with Apache Kafka and Delta Lake
Addressing the AI Data Challenge
Enterprises are rapidly building AI applications that require reliable, real-time data for better decisions and customer experiences. Yet, only 22 percent of enterprises are confident their current IT infrastructure is able to support these new AI applications. One of the major remaining hurdles they need to overcome is the divide between operational systems where data is generated and analytical systems where that data is turned into insights. Because these tools exist in separate silos, different teams, tools, and processes are applied between the two. The result is that teams are unable to marry real-time data with other systems in a meaningful way, and AI innovation on advanced use cases becomes impossible.
“For companies to maximize returns on their AI investments, they need their data, AI, analytics and governance all in one place,” said Ali Ghodsi, co-founder and CEO, Databricks. “As we help more organizations build data intelligence, trusted enterprise data sits at the center. We are excited that Confluent has embraced Unity Catalog and Delta Lake as its open governance and storage solutions of choice, and we look forward to working together to deliver long-term value for our customers.”
“Real-time data is the fuel for AI,” said Jay Kreps, co-founder and CEO, Confluent. “But too often, enterprises are held back by disconnected systems that fail to deliver the data they need, in the format they need, at the moment they need it. Together with Databricks, we’re ensuring businesses can harness the power of real-time data to build sophisticated AI-driven applications for their most critical use cases.”
Real-time Data, Ready for AI
To bridge the divide, Confluent and Databricks are announcing new integrations to ensure real-time interoperability and empower teams across the business to collaborate successfully. A bidirectional integration between Confluent’s Tableflow with Delta Lake and Databricks’ Unity Catalog, a unified and open governance solution for data and AI, will provide consistent, real-time data across operational and analytical systems that is discoverable, secure, and trustworthy.
Delta Lake, an open-format storage layer pioneered by Databricks, was originally developed for streaming use cases with fast writes. It has become the most adopted lakehouse format, proven out at a massive scale - processing over 10 exabytes of data daily. Now, Tableflow with Delta Lake makes operational data available immediately to Delta Lake’s rich ecosystem. Confluent and Databricks customers will be able to bring any engine or AI tool such as Apache Spark, Trino, Polars, DuckDB and Daft to their data in Unity Catalog.
Further, custom integrations between Tableflow and Databricks’ Unity Catalog will ensure metadata - a critical enabler for AI applications - is automatically applied to data exchanged between platforms. This makes operational data discoverable and actionable for data scientists and analysts working in Databricks while ensuring analytical data is equally accessible and useful for application developers and streaming engineers in Confluent. Additionally, Confluent’s Stream Governance suite will provide upstream governance and metadata to enhance fine-grained governance, end-to-end stream lineage, and automated data quality monitoring in Unity Catalog.
"Leveraging proximity to generation sources is a key factor not just in the energy sector, but also in the field of data,” said Dr. Dora Simroth, Head of Data and AI Engineering, E.ON Digital Technology. “Confluent and Databricks are already essential technologies in our Data and AI stack. These integrations will allow our practitioners to work on a single source of well-defined and timely data for both our operational and analytical plane. By partnering, Confluent and Databricks open up a faster path for us to build data and model-centric digital solutions.”
With these new capabilities, operational data from Confluent becomes a first-class citizen in Databricks, and Databricks data is easily accessible by any processor in the enterprise. The streaming data topics that AI applications consume and the tables that data analysts use will now have consistent views of the same real-time data, enabling faster, smarter AI-driven decision-making across the organization. This seamless integration between enterprise applications, analytics, and governance is critical for AI innovation at scale.
To learn more about the expanded partnership, read the blog from Databricks CEO Ali Ghodsi and Confluent CEO Jay Kreps: www.confluent.io/blog/confluent-and-databricks/
About Confluent
Confluent is the data streaming platform that is pioneering a fundamentally new category of data infrastructure that sets data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion—designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven back-end operations. To learn more, please visit www.confluent.io.
About Databricks
Databricks is the Data and AI company. More than 10,000 organizations worldwide — including Block, Comcast, Condé Nast, Rivian, Shell and over
Forward-Looking Statements
This press release contains forward-looking statements within the meaning of the Private Securities Litigation Reform Act of 1995. All statements other than statements of historical fact could be deemed forward-looking, including without limitation statements regarding expectations for the planned partnership between Databricks and Confluent, including anticipated benefits, features, and use cases for customers and AI applications. These forward-looking statements are subject to known and unknown risks, uncertainties, assumptions, and other factors that may cause actual results or outcomes to be materially different from any future results or outcomes expressed or implied by the forward-looking statements, including those described from time to time in Confluent’s filings with the Securities and Exchange Commission. Except as required by law, Confluent undertakes no obligation, and does not intend, to update these forward-looking statements.
Any unreleased services or features referenced in this announcement are not currently available and may not be made generally available on time or at all, as may be determined in Confluent’s and Databricks’ sole discretion. Any such referenced services or features do not represent promises to deliver, commitments, or obligations of either Confluent or Databricks and may not be incorporated into any contract. Customers should make their purchase decisions based upon services and features that are currently generally available.
View source version on businesswire.com: https://www.businesswire.com/news/home/20250211987246/en/
Media Contacts
Confluent
Kerry Tuttle
pr@confluent.io
Databricks
Grace Lynch
press@databricks.com
Source: Confluent, Inc.
FAQ
What is the impact of Confluent's (CFLT) partnership with Databricks on AI capabilities?
How does the CFLT-Databricks integration address enterprise AI data challenges?
What are the key features of Confluent's (CFLT) integration with Databricks Unity Catalog?
How much data does the Delta Lake platform process in the CFLT-Databricks partnership?
What tools can be used with CFLT's Tableflow and Databricks integration?
