Open Source Memory Speed Virtual Distributed Storage
Alluxio, formerly Tachyon, enables any application to interact with any data from any storage system at memory speed.
Get Started Download
What's New
Strata + Hadoop 2016 Singapore · Dec 7, 2016 by Jiri Simsa
Modern Software Architectures and Data Pipelines Panel
Scala by the Bay · Dec 19, 2016
Keep tabs on the following data storage startup vendors in 2017
TechTarget · Dec 16th, 2016
Unified Namespace
Alluxio's unified namespace provides applications the same file system APIs to access your data in any storage like SANs, distributed file systems or object stores.
Memory Speed
Alluxio's memory centric architecture enables applications to have memory speed I/O.
Efficient Data Sharing
Alluxio enables easy and efficient sharing of data across frameworks and applications at memory speed.
Framework Flexibility
Alluxio supports various existing frameworks, such as Spark, MapReduce, Flink, and its filesystem API seamlessly works with future frameworks and applications.
Tiered Storage
Alluxio tiered storage architecture makes our users efficiently leverage storage media other than memory, such as SSD, HDD, and others.
Run Everywhere
Alluxio runs well in cloud, on-premise, and hybrid cloud environments.
Customizable Data Management
Alluxio provides customizable and pluggable policies for defining data management behavior that best fits your workloads and needs
Hadoop Compatible
Alluxio provides Hadoop compatible file system interface. Any Hadoop applications can run on Alluxio without any code change.
Linear Scalability
Industry deployments demonstrates scalability to thousands of nodes.
Between Computation Frameworks and Storage Systems
Alluxio users can work with frameworks of their choice. Additionally, Alluxio enables new workloads across different storage systems.
Various frameworks can share data efficiently among each other. Alluxio's unified namespace enables applications to interact data in any storage system at memory speed. This future proven architecture enables users to extract value from data in any storage faster.
Strong Community
Alluxio has attracted contributors from over 100 institutions, including Alibaba, Alluxio, Baidu, CMU, Google, IBM, Intel, NJU, Red Hat, UC Berkeley and Yahoo. The project is the storage layer of the Berkeley Data Analytics Stack (BDAS) and also part of the Fedora distribution.
Number of Contributors to Alluxio
More Than 16,400 Contributions
More Than 2,420 Stars
Michael Franklin
Director of the AMPLab at UC Berkeley
Alluxio is the next project with roots in the AMPLab to have major impact. We see it playing a huge disruptive role in the evolution of the storage layer to handle the expanding range of big data use cases.
Wensong Zhang
CTO and Senior Research Fellow of Alibaba Cloud, founder of Linux Virtual Server
As the cloud computing business for Alibaba Group, the world’s leading e-commerce business, Alibaba manages many of the world’s largest data centers, including the largest big data cluster ever built in China. With Alluxio combined with AliCloud OSS as well as other AliCloud cloud service products, our customers can leverage the technology trends of hardware to run important jobs at the fastest performance. We have been contributing to the Alluxio open source community and believe that Alluxio will play a critical role in the future of big data infrastructure.
Ion Stoica
Professor at UC Berkeley, co-author of Spark, co-founder and executive chairman of DataBricks, co-director of UC Berkeley AMPLab
As a layer that abstracts away the differences of existing storage systems from the cluster computing frameworks such as Apache Spark and Hadoop MapReduce, Alluxio can enable the rapid evolution of the big data storage, similarly to the way the Internet Protocol (IP) has enabled the evolution of the Internet.
Michael Greene
Intel Vice President
Big data analytics is driving new requirements for distributed memory across clusters for real-time streaming, interactive queries, analytics and graph processing. We are excited to work with developer communities on Alluxio and to optimize Alluxio solutions on Intel platforms. Ultimately, this helps our customers create more innovative and high performance cloud and big data solutions.
James Peng
Baidu Chief Architect
As one of the largest Internet companies in the world, Baidu constantly faces the challenges of managing data at multi-petabyte scale. By adopting innovative technologies like Alluxio we are able to help our users extract meaningful and useful data almost instantly. Our deployment of an Alluxio cluster has already reached 1,000 workers, which is one of the largest Alluxio clusters in the world. The tiered storage of Alluxio has provided us great flexibility in managing data in large-scale. We are seeing an average 10-fold, and up to 30-fold performance improvement in supporting interactive query system and other types of workloads. This greatly improved the speed in making important business decisions.