CrowdStrike’s Humio Platform Unveils Scalability Benchmark Streaming Over One Petabyte of Data Per Day with Reduced Infrastructure and Operational Requirements

Rhea-AI Summary

Humio, a CrowdStrike company, has set a new industry benchmark by achieving over one petabyte of daily log data ingestion, operating at 30 million events per second across 45 nodes with 96 cores each.

This represents a 10x increase in capacity from its previous record, illustrating Humio's capability for real-time observability and operational efficiency. Their platform offers substantial cost savings, with 80% reduction in infrastructure costs and 75% in operational costs compared to legacy vendors, enhancing IT performance and security.

Positive

• Achieved benchmark of over one petabyte of data ingestion per day.
• 10x increase in data ingestion capability compared to previous benchmarks.
• 80% reduction in infrastructure costs compared to legacy log management vendors.
• 75% decrease in operational costs compared to legacy log management vendors.
• Real-time visibility with sub-second latency through index-free architecture.

Negative

• None.

Showcases 100% high-fidelity data ingestion from source to target at streaming speeds running 30M events per second on only 45 nodes with 96 cores each

AUSTIN, Texas--(BUSINESS WIRE)-- Humio, a CrowdStrike company and the only log management platform enabling complete observability for all streaming logs in real time and at scale, sets the standard for data ingestion by reaching a benchmark of over one petabyte of data ingestion per day. At this rate of unprecedented data intake, Humio gives DevOps, ITOps and SecOps teams the ability to get insights from their IT infrastructure through real-time visibility of their log data at massive scale.

In 2019, Humio was the first log management solution to reach a benchmark of 100TB per day of data. That test used 25 nodes with 64 cores each, running 2.1 million events per second. Recently, the Humio engineering team completed a one petabyte benchmark on 45 nodes with 96 cores each running 30 million events per second and delivering search results with sub-second latency through Humio’s index-free architecture. This is a 10x increase in data ingestion running on just 2.7x of the processing nodes.

Humio’s industry-leading total cost of ownership is based on the ability to remove the limitations present in legacy logging solutions, bringing unlimited ingest, reduced infrastructure costs, and lower operational costs. Even as they increase the amount of log data being added to Humio, customers have routinely found:

• Infrastructure cost is one-fifth (saving 80% or more) of the cost of legacy log management vendors.
• Operational cost is one-fourth (saving 75% or more) of the cost of legacy log management vendors.

Organizations increasingly need improved observability to enable faster response to events that affect customer experiences, supply chains and IT security. These efforts require a focus on reducing system outages, protecting the organization from vulnerabilities and ensuring optimal performance across their infrastructure. At the foundation of these efforts is data about the performance and health of IT systems. Humio allows users to ingest all types of data with 100% fidelity from source to target.

“The challenges facing DevOps, ITOps and SecOps teams are only growing with the speed and scale of log data increasing each day — and with data arriving from a complex array of systems and applications,” said Michael Sentonas, chief technology officer at Crowdstrike. “Data is growing at a rate faster than anyone can budget for or ingest, but it is critical for businesses to be able to consume log data to improve observability across the enterprise to solve critical IT, workloads, compliance and security needs. We are excited to show our customers and the industry the power of Humio’s modern platform and how it improves observability across enterprises at any scale and all budgets.”

Statista.com estimates that the amount of data will more than double over the next four years. The Humio petabyte benchmark anticipates this growth, allowing IT to add high-volume log sources within a unified data fabric. As the first log management company to provide an unlimited license for data ingestion in 2018, Humio users pay a fixed rate for license fees without worrying about going over budget or upgrading their license. Scaling up comes with minimal added cost.

As a disruptive log management platform, Humio enables complete observability to answer any question, explore threats and vulnerabilities, and gain valuable insights from all logs in real time. With this combination of massive scale and sub-second search capabilities, Humio provides a faster, more cost effective way to quickly and effectively deliver insights with a platform designed for ease of operations and stability at any scale.

“Unlike legacy log management systems, Humio doesn’t require organizations to deduplicate data as they increase data ingestion volumes nor do they have to make cost-based concessions on log files to include in the system,” said William McKnight of GigaOm. “With a one petabyte per day load rate, a user base can search over 1PB of data each day and get answers with sub-second latency, all while reducing the number of servers required to store, process and search the data.”

Acquired in early 2021, Humio has become a key technical differentiator for CrowdStrike underpinning both its expansion into the log management market as well as CrowdStrike’s XDR strategy and new XDR offering, Falcon XDR.

To learn how Humio achieved these results in the benchmark, download the white paper.

About Humio
Humio, a CrowdStrike company, offers an advanced, purpose-built log management platform that delivers the lowest total cost of ownership, industry-leading unlimited plans, minimal maintenance and training costs, and remarkably low compute and storage requirements. Humio is the only data platform that enables customers to log everything and answer anything in real time — at scale, with flexible hybrid deployment options. Humio’s modern, index-free architecture makes exploring and investigating all data flexible and blazing fast, even at scale. For more information, visit www.humio.com and follow @MeetHumio on Twitter.

View source version on businesswire.com: https://www.businesswire.com/news/home/20220308005315/en/

Kevin Benacci

CrowdStrike Corporate Communications

press@crowdstrike.com

Source: CrowdStrike Holdings, Inc.

FAQ

What is Humio's new log data ingestion benchmark in 2023?

Humio has achieved a benchmark of over one petabyte of log data ingestion per day.

How many events per second can Humio process?

Humio can process 30 million events per second.

How much has Humio improved its data ingestion since 2019?

Humio increased its data ingestion capacity by 10x, from 100TB per day in 2019 to over one petabyte now.

What are the operational cost savings reported by Humio users?

Humio users report operational costs that are 75% lower compared to traditional log management vendors.

What role does Humio play in CrowdStrike's strategy?

Humio is a key technical differentiator for CrowdStrike, enhancing its log management market expansion and XDR strategy.