hadoop2.4.1伪分布式安装
第一步配置jdk环境变量#tar -xf jdk-8u66-linux-x64.tar.gz -C /usr/src/
# cd !$
cd /usr/src/
#cd jdk1.8.0_66/
# vim /etc/profile
export JAVA_HOME=/usr/src/jdk1.8.0_66/ #这两行是增加的内容
export PATH=$JAVA_HOME/bin:$PATH #
"/etc/profile" 80L, 1868C 已写入
# source !$ #使文件生效
source /etc/profile
# java -version #验证jdk配置是否成功
java version "1.8.0_66"
Java(TM) SE Runtime Environment (build1.8.0_66-b17)
Java HotSpot(TM) 64-Bit Server VM (build25.66-b17, mixed mode)
出现上述结果证明jdk配置成功。
设置主机名
$ vim /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=hadoop #这里是主机名
NTPSERVERARGS=iburst
注意：如果主机名与IP地址不绑定的话，在格式化的时候会给出警告如下
unable to determine local hostname -falling back to localhos
可能会出现如下的错误：
SHUTDOWN_MSG: Shutting down NameNode at java.net.UnknownHostException: xuegod
解决办法就是使用 hostname -f 命令看是否会返回到主机名，像下面
# hostname -f
hadoop
否则的话按照上述方式修改过/etc/sysconfig/network/后重启即可。
绑定主机IP
# vim /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4localhost4.loca
ldomain4
::1 localhost localhost.localdomainlocalhost6 localhost6.loca
ldomain6
192.168.1.65hadoop
第二步配置SSH及添加hadoop用户实现免密码登录
# groupadd hadoop
# useradd -g hadoop hadoop
# echo 123456 | passwd--stdin hadoop
Changing password for user hadoop.
passwd: all authentication tokens updatedsuccessfully.
# su - hadoop
$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key(/home/hadoop/.ssh/id_rsa): #直接回车
Created directory '/home/hadoop/.ssh'.
Enter passphrase (empty for no passphrase): #直接回车
Enter same passphrase again: #直接回车
Your> Your public key has been saved in/home/hadoop/.ssh/id_rsa.pub.
The key fingerprint is: #直接回车
68:26:8b:0c:0d:f4:2e:e3:a4:f1:5a:02:bc:25:e7:37hadoop@xuegod
The key's randomart image is:
+--[ RSA 2048]----+
| . |
|. . |
|. . |
|.o. . |
|+*.+. + S |
|==O. = |
|oo=..E |
| + . . |
|. |
+-----------------+
$ ssh-copy-id localhost #拷贝公钥到免密码登录的服务器
The authenticity of host 'localhost (::1)'can't be established.
RSA key fingerprint is21:47:23:f9:04:8e:7a:fc:45:8b:1b:d8:9f:74:26:a9.
Are you sure you want to continue connecting(yes/no)? yes #输入yes
Warning: Permanently added 'localhost'(RSA) to the list of known hosts.
hadoop@localhost's password: #首次需要输入密码，以后就不需要了
Now try logging into the machine, with"ssh 'localhost'", and check in:
.ssh/authorized_keys
to make sure we haven't added extra keysthat you weren't expecting.
$ ssh localhost #测试
$ exit
logout
Connection to localhost closed.
第三步.配置hadoop
# tar -xfhadoop-2.4.1.tar.gz -C /usr/src/
# cd !$
cd /usr/src/
# cd hadoop-2.4.1/
# chown -Rhadoop:hadoop /usr/src/hadoop-2.4.1/
# chmod 775/usr/src/hadoop-2.4.1/
# ll -d !$
ll -d /usr/src/hadoop-2.4.1/
drwxrwxr-x 9 hadoop hadoop 4096 Jun 212014 /usr/src/hadoop-2.4.1/
3-1.配置hadoop2.4.1需要修改5个配置文件
第一个：hadoop-env.sh
$ vim hadoop-env.sh
export JAVA_HOME=/usr/src/jdk1.8.0_66/
第二个：core-site.xml
fs.defaultFS
hdfs://hadoop:9000
hadoop.tmp.dir
/home/hadoop/hadoop-2.4.1/tmp
第三个：hdfs-site.xml hdfs-default.xml
dfs.replication
1
第四个：mapred-site.xml (mv mapred-site.xml.template mapred-site.xml)
$ cp mapred-site.xml.template mapred-site.xml
mapreduce.framework.name
yarn
http://blog.51cto.com/e/u261/themes/default/images/spacer.gif
第五个：yarn-site.xml
yarn.resourcemanager.hostname
hadoop
yarn.nodemanager.aux-services
mapreduce_shuffle
http://blog.51cto.com/e/u261/themes/default/images/spacer.gif
3.2将hadoop添加到环境变量
vim /etc/proflie
export JAVA_HOME=/usr/src/jdk1.8.0_66/
export HADOOP_HOME=/usr/src/hadoop-2.4.1/
export PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH
http://blog.51cto.com/e/u261/themes/default/images/spacer.gif
$ vim /etc/profile
$ source !$
source /etc/profile
http://blog.51cto.com/e/u261/themes/default/images/spacer.gif
$ hadoop version
Hadoop 2.4.1
Subversionhttp://svn.apache.org/repos/asf/hadoop/common -r 1604318
Compiled by jenkins on 2014-06-21T05:43Z
Compiled with protoc 2.5.0
From source with checksum bb7ac0a3c73dc131f4844b873c74b630
This command was run using/usr/src/hadoop-2.4.1/share/hadoop/common/hadoop-common-2.4.1.jar
3.3格式化namenode（是对namenode进行初始化）
hdfsnamenode -format (hadoop namenode -format)
$ hdfs namenode -format
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode athadoop/192.168.1.65
************************************************************/
看到这条信息说明格式化成功！！！
3.4启动hadoop
先启动HDFS
$ start-dfs.sh
再启动YARN
$ start-yarn.sh
3.5验证是否启动成功
使用jps命令验证
$ jps
3089 NodeManager
2995 ResourceManager
3124 Jps
2662 DataNode
2570 NameNode
2843 SecondaryNameNode
http://blog.51cto.com/e/u261/themes/default/images/spacer.gif
http://192.168.1.65:50070/（HDFS 管理界面）
http://blog.51cto.com/e/u261/themes/default/images/spacer.gif
http://192.168.1.65:8088/cluster（MR管理界面）
页:
[1]