冰恋 发表于 2018-10-30 09:38:19

HBASE 0.98版本安装,一步曲:编译HADOOP 2.2.0 x64版本

  1、安装JDK
  下载JDK 7u55版本,安装
  JDK和JRE都需要,JDK里面有tools.jar,这个jar包是一定需要的
  安装在/java上
  2、下载Hadoop 2.2.0源代码
  wget http://apache.dataguru.cn/hadoop/common/stable/hadoop-2.2.0-src.tar.gz
  解压缩
  tar zxvf hadoop-2.2.0-src.tar.gz -C /tmp
  3、安装依赖包
  yum -y install lzo-devel zlib-devel gcc autoconf automake libtool gcc-c++ openssl-devel openssl-devel
  4、安装相关编译用软件
  Protobuf编译和安装
  tar -zxvf protobuf-2.5.0.tar.gz
  cd protobuf-2.5.0
  ./configure --prefix=/usr/local/protobuf
  make
  make install
  Ant安装
  tar -zxvf apache-ant-1.9.2-bin.tar.gz
  mv apache-ant-1.9.2 /usr/local/ant
  Maven安装
  tar -zxvf apache-maven-3.0.5-bin.tar.gz
  mv apache-maven-3.0.5 /usr/local/maven
  Findbugs安装
  tar -zxfv findbugs-2.0.2.tar.gz
  mv findbugs-2.0.2 /usr/local/findbugs
  cmake编译安装
  tar -zvxf cmake-2.8.8.tar.gz
  cd cmake-2.8.8
  ./bootstrap
  make
  make install
  5、配置路径
  vim /etc/profile
  #java
  export JAVA_HOME=/java
  export JRE_HOME=$JAVA_HOME/jre
  export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JRE_HOME/lib
  export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
  #maven
  export MAVEN_HOME=/usr/local/maven
  export MAVEN_OPTS="-Xms256m -Xmx512m"

  export>  export PATH=$PATH:$MAVEN_HOME/bin
  #protobuf
  export PROTOBUF_HOME=/usr/local/protobuf
  export CLASSPATH=.:$CLASSPATH:$PROTOBUF_HOME/lib
  export PATH=$PATH:$PROTOBUF_HOME/bin
  #ant
  export ANT_HOME=/usr/local/ant
  export CLASSPATH=.:$CLASSPATH:$ANT_HOME/lib
  export PATH=$PATH:$ANT_HOME/bin
  #findbugs
  export FINDBUGS_HOME=/usr/local/findbugs
  export CLASSPATH=.:$CLASSPATH:$FINDBUGS_HOME/lib
  export PATH=$PATH:$FINDBUGS_HOME/bin
  source /etc/profile
  即刻生效
  9、修改依赖Bug
  vim /hadoop-2.2.0/hadoop-common-project/hadoop-auth/pom.xml
  在dependency部分加入:
  org.mortbay.jetty
  jetty
  test
  org.mortbay.jetty
  jetty-util
  test
  10、编译
  cd hadoop-2.2.0-src
  mvn clean package -Pdist,native -DskipTests -Dtar
   ------------------------------------------------------------------------
   Reactor Summary:
  
   Apache Hadoop Main ................................ SUCCESS
   Apache Hadoop Project POM ......................... SUCCESS
   Apache Hadoop Annotations ......................... SUCCESS
   Apache Hadoop Assemblies .......................... SUCCESS
   Apache Hadoop Project Dist POM .................... SUCCESS
   Apache Hadoop Maven Plugins ....................... SUCCESS
   Apache Hadoop Auth ................................ SUCCESS
   Apache Hadoop Auth Examples ....................... SUCCESS
   Apache Hadoop Common .............................. SUCCESS
   Apache Hadoop NFS ................................. SUCCESS
   Apache Hadoop Common Project ...................... SUCCESS
   Apache Hadoop HDFS ................................ SUCCESS
   Apache Hadoop HttpFS .............................. SUCCESS
   Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS
   Apache Hadoop HDFS-NFS ............................ SUCCESS
   Apache Hadoop HDFS Project ........................ SUCCESS
   hadoop-yarn ....................................... SUCCESS
   hadoop-yarn-api ................................... SUCCESS
   hadoop-yarn-common ................................ SUCCESS
   hadoop-yarn-server ................................ SUCCESS
   hadoop-yarn-server-common ......................... SUCCESS
   hadoop-yarn-server-nodemanager .................... SUCCESS
   hadoop-yarn-server-web-proxy ...................... SUCCESS
   hadoop-yarn-server-resourcemanager ................ SUCCESS
   hadoop-yarn-server-tests .......................... SUCCESS
   hadoop-yarn-client ................................ SUCCESS
   hadoop-yarn-applications .......................... SUCCESS
   hadoop-yarn-applications-distributedshell ......... SUCCESS
   hadoop-mapreduce-client ........................... SUCCESS
   hadoop-mapreduce-client-core ...................... SUCCESS
   hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS
   hadoop-yarn-site .................................. SUCCESS
   hadoop-yarn-project ............................... SUCCESS
   hadoop-mapreduce-client-common .................... SUCCESS
   hadoop-mapreduce-client-shuffle ................... SUCCESS
   hadoop-mapreduce-client-app ....................... SUCCESS
   hadoop-mapreduce-client-hs ........................ SUCCESS
   hadoop-mapreduce-client-jobclient ................. SUCCESS
   hadoop-mapreduce-client-hs-plugins ................ SUCCESS
   Apache Hadoop MapReduce Examples .................. SUCCESS
   hadoop-mapreduce .................................. SUCCESS
   Apache Hadoop MapReduce Streaming ................. SUCCESS
   Apache Hadoop Distributed Copy .................... SUCCESS
   Apache Hadoop Archives ............................ SUCCESS
   Apache Hadoop Rumen ............................... SUCCESS
   Apache Hadoop Gridmix ............................. SUCCESS
   Apache Hadoop Data Join ........................... SUCCESS
   Apache Hadoop Extras .............................. SUCCESS
   Apache Hadoop Pipes ............................... SUCCESS
   Apache Hadoop Tools Dist .......................... SUCCESS
   Apache Hadoop Tools ............................... SUCCESS
   Apache Hadoop Distribution ........................ SUCCESS
   Apache Hadoop Client .............................. SUCCESS
   Apache Hadoop Mini-Cluster ........................ SUCCESS
   ------------------------------------------------------------------------
   BUILD SUCCESS
   ------------------------------------------------------------------------
   Total time: 34:15.365s
   Finished at: Fri May 16 16:15:37 CST 2014
   Final Memory: 101M/385M
   ------------------------------------------------------------------------
  编译完毕会在
  hadoop-2.2.0-src/hadoop-dist/target/
  产生一个包
  hadoop-2.2.0.tar.gz
  这个包就是最终可部署的hadoop包
  整个编程过程可能会出现中间失败的情况,有很多原因,有可能是因为连接主机下载依赖不成功。
  可以尝试:mvn clean package -Pdist,native -DskipTests -Dtar
  多来几次,就可以了。

页: [1]
查看完整版本: HBASE 0.98版本安装,一步曲:编译HADOOP 2.2.0 x64版本