Published on
Nov 6, 2024
As a staff engineer at Kloudfuse since the early days, I’ve had the opportunity to dive deep into our logs stream, working on everything from ingestion to querying and analytics. With the release of Kloudfuse 3.0, I’m excited to share some of the innovations we’ve made to enhance the efficiency, scalability, and usability of our logging engine.
Fingerprint Technology: Revolutionizing Log Analysis
One of our key advancements has been our patent-pending fingerprint technology. This innovative approach, which has been integral to our product, allows Kloudfuse to automatically detect patterns and signatures in incoming log messages. By summarizing logs based on their unique characteristics, we enable faster analysis and improved query capabilities, significantly accelerating root cause analysis.
Moreover, our fingerprinting technique reduces log storage requirements. Unlike traditional logging systems that often require log trimming and filtering, Kloudfuse separates each log line into static and dynamic components. By storing the static fingerprint and dynamic values separately, we provide a more cost-effective storage solution, allowing our customers to manage their log data with greater efficiency.
With this critical capability in place, we aimed to enhance usability further by introducing Facet Analytics.
Enhancing Usability with Facet Analytics
In response to customer feedback, we focused on improving the overall usability of our logging analytics. One exciting feature is the new facet explorer, which allows users to browse all detected facets from our logs parser and perform analytics on them. This functionality empowers users to dive deeper into their logs, analyzing by severity, source, version, and more.
The new features provide advanced search, filtering, bookmarking, and grouping options, thus significantly boosting log analysis and ease of use, helping customers navigate their logs more effectively than before.
Scaling as a Core Focus
As we continue to grow, scalability remains a top priority. In this release, in addition to usability, we’ve successfully engineered our system to handle over a million log events per second, making our system capable of supporting high-volume customer environments. Companies like 1MG and Innovaccer are already reaping the benefits of our enhanced scalability, experiencing faster and more efficient log analysis.
The Combined Effect
These three key features—automated extraction of important log attributes, scalable log ingestion and processing, and tools like Facet Analytics—help organizations quickly and easily find valuable insights in large volumes of log data.
As we continue to innovate and respond to our customers’ evolving needs, I’m excited to see how Kloudfuse will transform the way organizations harness their log data.
Stay tuned for more updates from us!