Introduction and requirements for Giraffa - GiraffaFS/giraffa GitHub Wiki
Giraffa is a distributed, highly scalable file system, which is aimed to be able to:
- Support millions of concurrent clients
- Store trillions of objects
- Maintain Exabyte total storage capacity
Giraffa is utilizing features of HDFS and HBase in order to scale both the data storage and its metadata. Giraffa keeps directories, files, and blocks in a single HBase table distributed across Region Servers, while file data are stored in blocks on HDFS DataNodes.
In order to use and develop Giraffa, you will need to install Java 7 (Java 8 has not been tested).
- Java can be downloaded from:
http://www.oracle.com/technetwork/java/javase/downloads/jdk7-downloads-1880260.html
Giraffa is using Gradle 2.5 as a build system:
- Gradle can be downloaded from: https://services.gradle.org/distributions
- Please follow "Installation Instructions" on download page to setup Gradle on your environment.
Giraffa currently runs using hbase-1.0.1 and hadoop-2.5.1. The links below are Apache mirror links to places to download them.
- HBase 1.0.1 can be downloaded from:
http://archive.apache.org/dist/hbase/hbase-1.0.1/hbase-1.0.1-bin.tar.gz - Hadoop 2.5.1 can be downloaded from:
http://archive.apache.org/dist/hadoop/common/hadoop-2.5.1/hadoop-2.5.1.tar.gz
Like Hadoop, Giraffa uses Google Protocol Buffers to generate some intermediate java file.
Please refer to Protobuf Git for installation guidance.
- Currently Giraffa uses Google Protocol Buffers 2.5.0, which can be downloaded from:
https://github.com/google/protobuf/releases/download/v2.5.0/protobuf-2.5.0.tar.gz
It is recommended you run Giraffa on a Linux distribution. Windows with Cygwin, and Mac, are also working.
It is highly recommended that you use Eclipse or InteliJ to work on Giraffa because it comes with Gradle and Git, which you will need in order to build Giraffa and to contribute source code.
- Eclipse can be downloaded from: http://www.eclipse.org/downloads/packages/
- Importing Gradle Project in Eclipse: http://makble.com/how-to-import-gradle-project-into-eclipse
If you choose not to use Eclipse, you may need to download Git separately. Follow git directions for installation.
- Git can be downloaded from: http://git-scm.com/downloads