2.配置hosts文件
所有的节点(gc,rac1,rac2)都修改/etc/hosts,使彼此之间都能把主机名解析为ip
[iyunv@gc ~]$ cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
192.168.2.101 rac1.localdomain rac1
192.168.2.102 rac2.localdomain rac2
192.168.2.100 gc.localdomain gc
3.建立hadoop运行账号
在所有的节点创建hadoop运行账号
[iyunv@gc ~]#groupadd hadoop
[iyunv@gc ~]#useradd -g hadoop grid--注意此处一定要指定分组,不然可能会不能建立互信
[iyunv@gc ~]# id grid
uid=501(grid) gid=54326(hadoop) groups=54326(hadoop)
[iyunv@gc ~]#passwd grid
Changing password for user grid.
New UNIX password:
BAD PASSWORD: it is too short
Retype new UNIX password:
passwd: all authentication tokens updated successfully.
4.配置ssh免密码连入
注意要以hadoop用户登录,在hadoop用户的主目录下进行操作。
每个节点做下面相同的操作
[hadoop@gc ~]$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/hadoop/.ssh/id_rsa):
Created directory '/home/hadoop/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/hadoop/.ssh/id_rsa.
Your public key has been saved in /home/hadoop/.ssh/id_rsa.pub.
The key fingerprint is:
54:80:fd:77:6b:87:97:ce:0f:32:34:43:d1:d2:c2:0d hadoop@gc.localdomain
[hadoop@gc ~]$ cd .ssh
[hadoop@gc .ssh]$ ls
id_rsa id_rsa.pub
把各个节点的authorized_keys的内容互相拷贝加入到对方的此文件中,然后就可以免密码彼此ssh连入。
在其中一节点(gc)节点就可完成操作
[hadoop@gc .ssh]$ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
[hadoop@gc .ssh]$ssh rac1 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
The authenticity of host 'rac1 (192.168.2.101)' can't be established.
RSA key fingerprint is 19:48:e0:0a:37:e1:2a:d5:ba:c8:7e:1b:37:c6:2f:0e.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac1,192.168.2.101' (RSA) to the list of known hosts.
hadoop@rac1's password:
[hadoop@gc .ssh]$ssh rac2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
The authenticity of host 'rac2 (192.168.2.102)' can't be established.
RSA key fingerprint is 19:48:e0:0a:37:e1:2a:d5:ba:c8:7e:1b:37:c6:2f:0e.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac2,192.168.2.102' (RSA) to the list of known hosts.
hadoop@rac2's password:
[hadoop@gc .ssh]$scp ~/.ssh/authorized_keys rac1:~/.ssh/authorized_keys
hadoop@rac1's password:
authorized_keys 100% 1213 1.2KB/s 00:00
[hadoop@gc .ssh]$scp ~/.ssh/authorized_keys rac2:~/.ssh/authorized_keys
hadoop@rac2's password:
authorized_keys 100% 1213 1.2KB/s 00:00
[hadoop@gc .ssh]$ ll
总计 16
-rw-rw-r-- 1 hadoop hadoop 1213 10-30 09:18 authorized_keys
-rw------- 1 hadoop hadoop 1675 10-30 09:05 id_rsa
-rw-r--r-- 1 hadoop hadoop 403 10-30 09:05 id_rsa.pub
--分别测试连接
[grid@gc .ssh]$ ssh rac1 date
2012年 11月 18日星期日01:35:39 CST
[grid@gc .ssh]$ ssh rac2 date
2012年 10月 30日星期二09:52:46 CST
7.格式化namenode
--分别在各节点进行格式化
[grid@rac2 bin]$ pwd
/home/grid/hadoop-0.20.2/bin
[grid@gc bin]$ ./hadoop namenode –format
12/10/31 08:03:31 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = gc.localdomain/192.168.2.100
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
12/10/31 08:03:31 INFO namenode.FSNamesystem: fsOwner=grid,hadoop
12/10/31 08:03:31 INFO namenode.FSNamesystem: supergroup=supergroup
12/10/31 08:03:31 INFO namenode.FSNamesystem: isPermissionEnabled=true
12/10/31 08:03:32 INFO common.Storage: Image file of size 94 saved in 0 seconds.
12/10/31 08:03:32 INFO common.Storage: Storage directory /tmp/hadoop-grid/dfs/name has been successfully formatted.
12/10/31 08:03:32 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at gc.localdomain/192.168.2.100
************************************************************/
8.启动hadoop
--在master节点启动hadoop守护进程
[grid@gc bin]$ pwd
/home/grid/hadoop-0.20.2/bin
[grid@gc bin]$./start-all.sh
starting namenode, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-namenode-gc.localdomain.out
rac2: starting datanode, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-datanode-rac2.localdomain.out
rac1: starting datanode, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-datanode-rac1.localdomain.out
The authenticity of host 'gc (192.168.2.100)' can't be established.
RSA key fingerprint is 8e:47:42:44:bd:e2:28:64:10:40:8e:b5:72:f9:6c:82.
Are you sure you want to continue connecting (yes/no)? yes
gc: Warning: Permanently added 'gc,192.168.2.100' (RSA) to the list of known hosts.
gc: starting secondarynamenode, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-secondarynamenode-gc.localdomain.out
starting jobtracker, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-jobtracker-gc.localdomain.out
rac2: starting tasktracker, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-tasktracker-rac2.localdomain.out
rac1: starting tasktracker, logging to /home/grid/hadoop-0.20.2/bin/../logs/hadoop-grid-tasktracker-rac1.localdomain.out