Powered by Apache Accumulo and Hadoop, the big data platform Sqrrl Enterprise is a scalable NoSQL database for real-time big data applications. By integrating Sqrrl Enterprise and Fusion ioMemory, database architects could scale up an Accumulo big data system to accelerate performance with up to ten times more density.
“Fusion-io provides breakthrough performance improvements and cost savings for big data technology deployments,” said Ely Kahn, Vice President of Business Development for software provider Sqrrl. “By bringing our solutions together, we have created an innovative architecture that is fast, secure, and cost effective. Together, the Fusion-io and Sqrrl solution can help more organizations make better decisions backed by powerful real-time big data applications.”
Apache Accumulo is a powerful NoSQL database used throughout the federal government and by various industries, such as healthcare, finance, and telecommunications. Sqrrl Enterprise extends the capabilities of Accumulo with additional management, security, and real-time analytical features. While traditional Accumulo systems may utilize 128GB of DRAM to cache the working data set, an ioMemory-equipped server can support 12.8TB or more data. This ensures the entire dataset is microseconds away from the server CPU. Each ioMemory device would be able to support 1.5GB/s of bandwidth and hundreds of thousands of transactions per second with reliable, predictable performance.
Flash memory vs. DRAM
A conventional Accumulo-based system typically relies on costly Dynamic Random Access Memory (DRAM) for performance. In addition to the physical limit to how much DRAM can be added to any system, servers built with very large DRAM configurations could quickly exceed budgets. Furthermore, unlike persistent NAND flash memory, DRAM does not retain data in the event of an unexpected power loss. Providing significantly more performance at a fraction of the cost of high-density DRAM systems, the Accumulo solution powered by Fusion ioMemory would also consume significantly less power per gigabyte.
“From predicting weather patterns to managing national security, the public sector relies on big data more than ever before to make decisions that affect millions of people,” said Christian Shrauder, Fusion-io Federal CTO. “Fusion-io is pleased to work with Sqrrl to provide a secure platform based on ioMemory and Accumulo-powered Sqrrl Enterprise to meet the highly demanding government data requirements with an architecture that expands access to information that could improve or even save lives around the world.”