Sqrrl Enterprise is the only solution that offers the combination of cell-level security controls, petabyte scalability for multi-structured data, native Hadoop integration, and diverse analytic capabilities, including full-text search, aggregations, and graph analysis. It is built on Apache Accumulo, and customers use Sqrrl Enterprise to rapidly build applications on top of their Big Data.
Development of Accumulo began in 2008, when the National Security Agency (NSA) began searching for a new data store that could meet its growing data challenges. NSA requirements included:
- Elastic scalability to petabytes of data
- Flexible schemas that could easily accommodate unstructured or semi-structured data
- Fine-grained security controls that would enable the mixing of data with different security requirements
- The ability to run on inexpensive, commodity hardware to minimize costs
- Very fast read and write access to the data
- Rapid application development for Big Data analytics
No database solution existed at the time that met these requirements, so NSA decided to build a solution of scratch (with some help from Google’s BigTable paper). NSA called this new data store Accumulo.
Today Accumulo is used throughout the Department of Defense and the U.S. Intelligence Community and by various companies.In late 2011 NSA open sourced Accumulo, and in the spring of 2012 Accumulo become a top-level project at the Apache Foundation.
In the summer of 2012 a group of the core creators, committers, and contributors to the Accumulo project created Sqrrl to bring the benefits of Accumulo to organizations in a wide variety of industries.