设为首页 收藏本站
查看: 1157|回复: 0

[经验分享] HBASE 0.98版本安装,一步曲:编译HADOOP 2.2.0 x64版本

[复制链接]

尚未签到

发表于 2018-10-30 09:38:19 | 显示全部楼层 |阅读模式
  1、安装JDK
  下载JDK 7u55版本,安装
  JDK和JRE都需要,JDK里面有tools.jar,这个jar包是一定需要的
  安装在/java上
  2、下载Hadoop 2.2.0源代码
  wget http://apache.dataguru.cn/hadoop/common/stable/hadoop-2.2.0-src.tar.gz
  解压缩
  tar zxvf hadoop-2.2.0-src.tar.gz -C /tmp
  3、安装依赖包
  yum -y install lzo-devel zlib-devel gcc autoconf automake libtool gcc-c++ openssl-devel openssl-devel
  4、安装相关编译用软件
  Protobuf编译和安装
  tar -zxvf protobuf-2.5.0.tar.gz
  cd protobuf-2.5.0
  ./configure --prefix=/usr/local/protobuf
  make
  make install
  Ant安装
  tar -zxvf apache-ant-1.9.2-bin.tar.gz
  mv apache-ant-1.9.2 /usr/local/ant
  Maven安装
  tar -zxvf apache-maven-3.0.5-bin.tar.gz
  mv apache-maven-3.0.5 /usr/local/maven
  Findbugs安装
  tar -zxfv findbugs-2.0.2.tar.gz
  mv findbugs-2.0.2 /usr/local/findbugs
  cmake编译安装
  tar -zvxf cmake-2.8.8.tar.gz
  cd cmake-2.8.8
  ./bootstrap
  make
  make install
  5、配置路径
  vim /etc/profile
  #java
  export JAVA_HOME=/java
  export JRE_HOME=$JAVA_HOME/jre
  export CLASSPATH=.:$CLASSPATH:$JAVA_HOME/lib:$JRE_HOME/lib
  export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin
  #maven
  export MAVEN_HOME=/usr/local/maven
  export MAVEN_OPTS="-Xms256m -Xmx512m"

  export>  export PATH=$PATH:$MAVEN_HOME/bin
  #protobuf
  export PROTOBUF_HOME=/usr/local/protobuf
  export CLASSPATH=.:$CLASSPATH:$PROTOBUF_HOME/lib
  export PATH=$PATH:$PROTOBUF_HOME/bin
  #ant
  export ANT_HOME=/usr/local/ant
  export CLASSPATH=.:$CLASSPATH:$ANT_HOME/lib
  export PATH=$PATH:$ANT_HOME/bin
  #findbugs
  export FINDBUGS_HOME=/usr/local/findbugs
  export CLASSPATH=.:$CLASSPATH:$FINDBUGS_HOME/lib
  export PATH=$PATH:$FINDBUGS_HOME/bin
  source /etc/profile
  即刻生效
  9、修改依赖Bug
  vim /hadoop-2.2.0/hadoop-common-project/hadoop-auth/pom.xml
  在dependency部分加入:
  org.mortbay.jetty
  jetty
  test
  org.mortbay.jetty
  jetty-util
  test
  10、编译
  cd hadoop-2.2.0-src
  mvn clean package -Pdist,native -DskipTests -Dtar
  [INFO] ------------------------------------------------------------------------
  [INFO] Reactor Summary:
  [INFO]
  [INFO] Apache Hadoop Main ................................ SUCCESS [10.796s]
  [INFO] Apache Hadoop Project POM ......................... SUCCESS [8.171s]
  [INFO] Apache Hadoop Annotations ......................... SUCCESS [18.306s]
  [INFO] Apache Hadoop Assemblies .......................... SUCCESS [1.704s]
  [INFO] Apache Hadoop Project Dist POM .................... SUCCESS [8.222s]
  [INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [17.120s]
  [INFO] Apache Hadoop Auth ................................ SUCCESS [15.952s]
  [INFO] Apache Hadoop Auth Examples ....................... SUCCESS [12.085s]
  [INFO] Apache Hadoop Common .............................. SUCCESS [4:57.617s]
  [INFO] Apache Hadoop NFS ................................. SUCCESS [25.393s]
  [INFO] Apache Hadoop Common Project ...................... SUCCESS [0.231s]
  [INFO] Apache Hadoop HDFS ................................ SUCCESS [5:51.635s]
  [INFO] Apache Hadoop HttpFS .............................. SUCCESS [1:27.220s]
  [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS [59.011s]
  [INFO] Apache Hadoop HDFS-NFS ............................ SUCCESS [11.979s]
  [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.195s]
  [INFO] hadoop-yarn ....................................... SUCCESS [1:41.292s]
  [INFO] hadoop-yarn-api ................................... SUCCESS [1:53.028s]
  [INFO] hadoop-yarn-common ................................ SUCCESS [1:47.889s]
  [INFO] hadoop-yarn-server ................................ SUCCESS [0.712s]
  [INFO] hadoop-yarn-server-common ......................... SUCCESS [38.517s]
  [INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [53.352s]
  [INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [13.733s]
  [INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [49.935s]
  [INFO] hadoop-yarn-server-tests .......................... SUCCESS [3.230s]
  [INFO] hadoop-yarn-client ................................ SUCCESS [23.036s]
  [INFO] hadoop-yarn-applications .......................... SUCCESS [0.690s]
  [INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [7.623s]
  [INFO] hadoop-mapreduce-client ........................... SUCCESS [0.581s]
  [INFO] hadoop-mapreduce-client-core ...................... SUCCESS [1:26.644s]
  [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS [8.783s]
  [INFO] hadoop-yarn-site .................................. SUCCESS [1.217s]
  [INFO] hadoop-yarn-project ............................... SUCCESS [30.587s]
  [INFO] hadoop-mapreduce-client-common .................... SUCCESS [1:19.185s]
  [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [17.693s]
  [INFO] hadoop-mapreduce-client-app ....................... SUCCESS [41.929s]
  [INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [18.209s]
  [INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [24.663s]
  [INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [7.631s]
  [INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [22.663s]
  [INFO] hadoop-mapreduce .................................. SUCCESS [10.093s]
  [INFO] Apache Hadoop MapReduce Streaming ................. SUCCESS [19.489s]
  [INFO] Apache Hadoop Distributed Copy .................... SUCCESS [51.046s]
  [INFO] Apache Hadoop Archives ............................ SUCCESS [7.621s]
  [INFO] Apache Hadoop Rumen ............................... SUCCESS [20.543s]
  [INFO] Apache Hadoop Gridmix ............................. SUCCESS [15.156s]
  [INFO] Apache Hadoop Data Join ........................... SUCCESS [9.968s]
  [INFO] Apache Hadoop Extras .............................. SUCCESS [9.504s]
  [INFO] Apache Hadoop Pipes ............................... SUCCESS [15.708s]
  [INFO] Apache Hadoop Tools Dist .......................... SUCCESS [5.261s]
  [INFO] Apache Hadoop Tools ............................... SUCCESS [0.268s]
  [INFO] Apache Hadoop Distribution ........................ SUCCESS [1:15.418s]
  [INFO] Apache Hadoop Client .............................. SUCCESS [29.025s]
  [INFO] Apache Hadoop Mini-Cluster ........................ SUCCESS [0.735s]
  [INFO] ------------------------------------------------------------------------
  [INFO] BUILD SUCCESS
  [INFO] ------------------------------------------------------------------------
  [INFO] Total time: 34:15.365s
  [INFO] Finished at: Fri May 16 16:15:37 CST 2014
  [INFO] Final Memory: 101M/385M
  [INFO] ------------------------------------------------------------------------
  编译完毕会在
  hadoop-2.2.0-src/hadoop-dist/target/
  产生一个包
  hadoop-2.2.0.tar.gz
  这个包就是最终可部署的hadoop包
  整个编程过程可能会出现中间失败的情况,有很多原因,有可能是因为连接主机下载依赖不成功。
  可以尝试:mvn clean package -Pdist,native -DskipTests -Dtar
  多来几次,就可以了。


运维网声明 1、欢迎大家加入本站运维交流群:群②:261659950 群⑤:202807635 群⑦870801961 群⑧679858003
2、本站所有主题由该帖子作者发表,该帖子作者与运维网享有帖子相关版权
3、所有作品的著作权均归原作者享有,请您和我们一样尊重他人的著作权等合法权益。如果您对作品感到满意,请购买正版
4、禁止制作、复制、发布和传播具有反动、淫秽、色情、暴力、凶杀等内容的信息,一经发现立即删除。若您因此触犯法律,一切后果自负,我们对此不承担任何责任
5、所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其内容的准确性、可靠性、正当性、安全性、合法性等负责,亦不承担任何法律责任
6、所有作品仅供您个人学习、研究或欣赏,不得用于商业或者其他用途,否则,一切后果均由您自己承担,我们对此不承担任何法律责任
7、如涉及侵犯版权等问题,请您及时通知我们,我们将立即采取措施予以解决
8、联系人Email:admin@iyunv.com 网址:www.yunweiku.com

所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其承担任何法律责任,如涉及侵犯版权等问题,请您及时通知我们,我们将立即处理,联系人Email:kefu@iyunv.com,QQ:1061981298 本贴地址:https://www.yunweiku.com/thread-628303-1-1.html 上篇帖子: Hadoop Hive的限制 下篇帖子: HADOOP 格式化 namenode节点 准备脚本
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

扫码加入运维网微信交流群X

扫码加入运维网微信交流群

扫描二维码加入运维网微信交流群,最新一手资源尽在官方微信交流群!快快加入我们吧...

扫描微信二维码查看详情

客服E-mail:kefu@iyunv.com 客服QQ:1061981298


QQ群⑦:运维网交流群⑦ QQ群⑧:运维网交流群⑧ k8s群:运维网kubernetes交流群


提醒:禁止发布任何违反国家法律、法规的言论与图片等内容;本站内容均来自个人观点与网络等信息,非本站认同之观点.


本站大部分资源是网友从网上搜集分享而来,其版权均归原作者及其网站所有,我们尊重他人的合法权益,如有内容侵犯您的合法权益,请及时与我们联系进行核实删除!



合作伙伴: 青云cloud

快速回复 返回顶部 返回列表