hadoop编译配置以支持snappy - yingziaiai/SetupEnv GitHub Wiki

linux中，安装程序，指定路径./configure --prefix= http://www.tuicool.com/articles/FnU7ba

CDH版本的hadoop与Apache版本的hadoop编译法不一样：对于Apache的hadoop版本，只需要按默认方式安装好snappy, 并将编译好的native包copy到已安装的hadoop native下即可；但对于CDH的，http://www.cnblogs.com/ivanny/p/cdh_hadoop_with_snappy.html

当然按这个编译也出现了一个小问题：http://bbs.csdn.net/topics/390856968 ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (dist) on project hadoop-hdfs-httpfs: An Ant BuildException has occured: exec returned: 2 [ERROR] around Ant part ...... @ 10:134 in /home/pory/workplace/hadoop-2.4.1-src/hadoop-hdfs-project/hadoop-hdfs-httpfs/target/antrun/build-main.xml

然后到对应的download里删除下载的只有5M的apache-tomcat即可，而不是https://my.oschina.net/laigous/blog/356552这里描述的解决方案。

mvn package -Pdist,native -DskipTests -Dtar -Drequire.snappy 会出现错误：http://blog.csdn.net/feng27156/article/details/40150667 [ERROR] Exit code: 137 - /usr/hadoop/workspace/hadoop-2.4.1-src/hadoop-hdfs-project/hadoop-hdfs/src/main/Java/org/apache/hadoop/hdfs/tools/offlineEditsViewer/XmlEditsVisitor.java:32: 警告: OutputFormat是内部专用 API, 可能会在未来发行版中删除 [ERROR] import com.sun.org.apache.xml.internal.serialize.OutputFormat; [ERROR] ^ [ERROR] /usr/hadoop/workspace/hadoop-2.4.1-src/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tool

mvn package -Pdist,native -DskipTests -Dtar -Drequire.snappy 也出现过错误 http://kabike.iteye.com/blog/2023625 由于未安装snappy在默认位置，编译时也未指定，所以删除原来安装的 sudo make uninstall http://blog.csdn.net/liuzhaofu836459840/article/details/7381756

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-common: An Ant BuildException has occured: exec returned: 1 [ERROR] around Ant part ...... @ 4:136 in /usr/local/odpf/hadoop-2.3.0-src/hadoop-common-project/hadoop-common/target/antrun/build-main.xml [ERROR] -> [Help 1]

http://www.tuicool.com/articles/vQzMRbQ mvn clean package -DskipTests -Pdist,native -Dtar -Dsnappy.lib=(hadoop-snappy里面编译后的库地址) -Dbundle.snappy 按这种方式，编译是成功了，但是也是checknative时提示snappy false:....

http://www.lxway.com/500989092.htm 之前还犯过的错误是把apache hadoop编译的native 换到了cdh下，虽然checknative成功的，但是在hive下使用时： Exceptionin thread "main" java.lang.UnsatisfiedLinkError:org.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray(IIBIBIILjav