Cloudera Mountable HDFS (hadoop-fuse-dfs).
使用 cloudera 挂载HDFS ,关于部署HDFS 可以参考这里前一段时间做HDFS 测试,mount HDFS 过程 ,整理一下分享!
1 获取cdh3 yum 源
[*]wget -c http://archive.cloudera.com/redhat/cdh/cdh3-repository-1.0-1.noarch.rpm
2 安装下载的rpm 包
[*]yum --nogpgcheck localinstall cdh3-repository-1.0-1.noarch.rpm
//安装后将得到 cloudera-cdh3.repo 文件
[*]# ll /etc/yum.repos.d/
[*]total 40
[*]-rw-r--r-- 1 root root 1926 Aug 292011 CentOS-Base.repo
[*]-rw-r--r-- 1 root root631 Aug 292011 CentOS-Debuginfo.repo
[*]-rw-r--r-- 1 root root626 Aug 292011 CentOS-Media.repo
[*]-rw-r--r-- 1 root root 5390 Aug 292011 CentOS-Vault.repo
[*]-rw-r--r-- 1 root root201 Jul 142011 cloudera-cdh3.repo
3 导入 rpm key
[*]rpm --import http://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
4 安装 hadoop-0.20-fuse
[*]yum install hadoop-0.20-fuse
5 安装配置java 环境
[*]//下载安装jdk
[*]chmod +x jdk-6u26-linux-x64-rpm.bin
[*]./jdk-6u26-linux-x64-rpm.bin
[*]
[*]//编辑 profile
[*]vim /etc/profile
[*]export JAVA_HOME=/usr/java/jdk1.6.0_26
[*]export PATH=$JAVA_HOME/bin:$PATH
[*]
[*]//载入环境变量
[*]souce /etc/profile
6 配置 /etc/hosts文件添加namenode
[*]vim /etc/hosts
[*]
[*]10.0.100.75 namenode
7 创建挂载点并挂载hdfs
[*]mkdir -p /data/hdfs/
[*]chown -R hdfs:hdfs /data/hdfs/
[*]hadoop-fuse-dfs dfs://namenode:8020 /data/hdfs
8 卸载hdfs
[*]umount /data/hdfs
结束
参考
https://ccp.cloudera.com/display/CDHDOC/Mountable+HDFS
页:
[1]