设为首页 收藏本站
查看: 800|回复: 0

小功告成,在WIN7上配置上了HADOOP,终于可以一窥真容啦

[复制链接]

尚未签到

发表于 2015-5-19 10:28:42 | 显示全部楼层 |阅读模式
  主要参考文档:
  http://blog.iyunv.com/ruby97/article/details/7423088
  以后,慢慢熟悉具体操作吧。
DSC0000.png
  sky@koala
  /home/hadoop-0.20.2
  $ cd conf
  sky@koala
  /home/hadoop-0.20.2/conf
  $ dos2unix hadoop-env.sh
  dos2unix: converting file hadoop-env.sh to Unix format ...
  sky@koala
  /home/hadoop-0.20.2/conf
  $ cd ..
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop namenode -format
  13/03/19 10:19:46 INFO namenode.NameNode: STARTUP_MSG:
  /************************************************************
  STARTUP_MSG: Starting NameNode
  STARTUP_MSG:   host = koala/192.168.7.9
  STARTUP_MSG:   args = [-format]
  STARTUP_MSG:   version = 0.20.2
  STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
  ************************************************************/
  13/03/19 10:19:47 INFO namenode.FSNamesystem: fsOwner=sky,Domain,Users,Administrators,Remote,Desktop,Users,Users,Remote,Desktop,Users,Administrators
  13/03/19 10:19:47 INFO namenode.FSNamesystem: supergroup=supergroup
  13/03/19 10:19:47 INFO namenode.FSNamesystem: isPermissionEnabled=true
  13/03/19 10:19:47 INFO common.Storage: Image file of size 101 saved in 0 seconds.
  13/03/19 10:19:47 INFO common.Storage: Storage directory \tmp\hadoop-Sky\dfs\name has been successfully formatted.
  13/03/19 10:19:47 INFO namenode.NameNode: SHUTDOWN_MSG:
  /************************************************************
  SHUTDOWN_MSG: Shutting down NameNode at koala/192.168.X.X
  ************************************************************/
  sky@koala
  /home/hadoop-0.20.2
  $ bin/start-all.sh
  starting namenode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-namenode-koala.out
  localhost: starting datanode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-datanode-koala.out
  localhost: cygwin warning:
  localhost:   MS-DOS style path detected: C:\cygwin\home\hadoop-0.20.2\/build/native
  localhost:   Preferred POSIX equivalent is: /home/hadoop-0.20.2/build/native
  localhost:   CYGWIN environment variable option "nodosfilewarning" turns off this warning.
  localhost:   Consult the user's guide for more details about POSIX paths:
  localhost:     http://cygwin.com/cygwin-ug-net/using.html#using-pathnames
  localhost: starting secondarynamenode, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-secondarynamenode-koala.out
  localhost: log4j:ERROR setFile(null,true) call failed.
  localhost: java.io.FileNotFoundException: C:\cygwin\home\hadoop-0.20.2\logs\hadoop-sky-secondarynamenode-koala.log (Access is denied)
  localhost:      at java.io.FileOutputStream.openAppend(Native Method)
  localhost:      at java.io.FileOutputStream.(FileOutputStream.java:192)
  localhost:      at java.io.FileOutputStream.(FileOutputStream.java:116)
  localhost:      at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
  localhost:      at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
  localhost:      at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
  localhost:      at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
  localhost:      at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)
  starting jobtracker, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-jobtracker-koala.out
  localhost: starting tasktracker, logging to /home/hadoop-0.20.2/bin/../logs/hadoop-sky-tasktracker-koala.out
  localhost: log4j:ERROR setFile(null,true) call failed.
  localhost: java.io.FileNotFoundException: C:\cygwin\home\hadoop-0.20.2\logs\hadoop-sky-tasktracker-koala.log (Access is denied)
  localhost:      at java.io.FileOutputStream.openAppend(Native Method)
  localhost:      at java.io.FileOutputStream.(FileOutputStream.java:192)
  localhost:      at java.io.FileOutputStream.(FileOutputStream.java:116)
  localhost:      at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
  localhost:      at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
  localhost:      at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
  localhost:      at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
  localhost:      at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)
  sky@koala
  /home/hadoop-0.20.2
  $ jps
  956 JobTracker
  7344 NameNode
  6912 Jps
  sky@koala
  /home/hadoop-0.20.2
  $ ps
  PID    PPID    PGID     WINPID   TTY     UID    STIME COMMAND
  10252       1   12080       9788  ?       1001 10:22:03 /cygdrive/c/Java/jdk1.6.0_43/bin/java
  10812       1   11428        956  pty0    1001 10:22:04 /cygdrive/c/Java/jdk1.6.0_43/bin/java
  5344   10852    5344      10076  pty0    1001 10:22:28 /usr/bin/ps
  10852    1824   10852      12052  pty0    1001 22:50:39 /usr/bin/bash
  2032       1    9660      11484  ?       1001 10:22:01 /cygdrive/c/Java/jdk1.6.0_43/bin/java
  1824       1    1824       1824  ?       1001 22:50:39 /usr/bin/mintty
  7692       1   11428       7344  pty0    1001 10:21:59 /cygdrive/c/Java/jdk1.6.0_43/bin/java
  5228       1   10496       8688  ?       1001 10:22:06 /cygdrive/c/Java/jdk1.6.0_43/bin/java
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop fs -mkdir In
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop fs -put *.txt In
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop fs -ls
  Found 1 items
  drwxr-xr-x   - supergroup          0 2013-03-19 10:23 /user/In
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop fs -put *.pdf In
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop fs -ls /user/
  Found 1 items
  drwxr-xr-x   - supergroup          0 2013-03-19 10:28 /user/In
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop fs -ls /user/In
  Found 5 items
  -rw-r--r--   1 supergroup     348624 2013-03-19 10:23 /user/In/CHANGES.txt
  -rw-r--r--   1 supergroup      13366 2013-03-19 10:23 /user/In/LICENSE.txt
  -rw-r--r--   1 supergroup        101 2013-03-19 10:23 /user/In/NOTICE.txt
  -rw-r--r--   1 supergroup   38321433 2013-03-19 10:28 /user/In/ObjectLearn.pdf
  -rw-r--r--   1 supergroup       1366 2013-03-19 10:23 /user/In/README.txt
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop dfsadmin -report
  Configured Capacity: 104752738304 (97.56 GB)
  Present Capacity: 61319459840 (57.11 GB)
  DFS Remaining: 61280444416 (57.07 GB)
  DFS Used: 39015424 (37.21 MB)
  DFS Used%: 0.06%
  Under replicated blocks: 0
  Blocks with corrupt replicas: 0
  Missing blocks: 0
  -------------------------------------------------
  Datanodes available: 1 (1 total, 0 dead)
  Name: 127.0.0.1:50010
  Decommission Status : Normal
  Configured Capacity: 104752738304 (97.56 GB)
  DFS Used: 39015424 (37.21 MB)
  Non DFS Used: 43433278464 (40.45 GB)
  DFS Remaining: 61280444416(57.07 GB)
  DFS Used%: 0.04%
  DFS Remaining%: 58.5%
  Last contact: Tue Mar 19 10:40:52 CST 2013
  
  
  sky@koala
  /home/hadoop-0.20.2
  $ bin/hadoop dfs -lsr /
  sky@koala
  /home/hadoop-0.20.2
  $

运维网声明 1、欢迎大家加入本站运维交流群:群②:261659950 群⑤:202807635 群⑦870801961 群⑧679858003
2、本站所有主题由该帖子作者发表,该帖子作者与运维网享有帖子相关版权
3、所有作品的著作权均归原作者享有,请您和我们一样尊重他人的著作权等合法权益。如果您对作品感到满意,请购买正版
4、禁止制作、复制、发布和传播具有反动、淫秽、色情、暴力、凶杀等内容的信息,一经发现立即删除。若您因此触犯法律,一切后果自负,我们对此不承担任何责任
5、所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其内容的准确性、可靠性、正当性、安全性、合法性等负责,亦不承担任何法律责任
6、所有作品仅供您个人学习、研究或欣赏,不得用于商业或者其他用途,否则,一切后果均由您自己承担,我们对此不承担任何法律责任
7、如涉及侵犯版权等问题,请您及时通知我们,我们将立即采取措施予以解决
8、联系人Email:admin@iyunv.com 网址:www.yunweiku.com

所有资源均系网友上传或者通过网络收集,我们仅提供一个展示、介绍、观摩学习的平台,我们不对其承担任何法律责任,如涉及侵犯版权等问题,请您及时通知我们,我们将立即处理,联系人Email:kefu@iyunv.com,QQ:1061981298 本贴地址:https://www.yunweiku.com/thread-68458-1-1.html 上篇帖子: 关于win7 下安装sql server2005 企业管理器不成功问题 下篇帖子: Win7系统下双击运行jar文件
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

扫码加入运维网微信交流群X

扫码加入运维网微信交流群

扫描二维码加入运维网微信交流群,最新一手资源尽在官方微信交流群!快快加入我们吧...

扫描微信二维码查看详情

客服E-mail:kefu@iyunv.com 客服QQ:1061981298


QQ群⑦:运维网交流群⑦ QQ群⑧:运维网交流群⑧ k8s群:运维网kubernetes交流群


提醒:禁止发布任何违反国家法律、法规的言论与图片等内容;本站内容均来自个人观点与网络等信息,非本站认同之观点.


本站大部分资源是网友从网上搜集分享而来,其版权均归原作者及其网站所有,我们尊重他人的合法权益,如有内容侵犯您的合法权益,请及时与我们联系进行核实删除!



合作伙伴: 青云cloud

快速回复 返回顶部 返回列表