Hadoop2.6.0学习笔记（一）MapReduce介绍
$ hadoop jar WCApp.jar /data /wc-20151129010115/11/29 00:20:37 INFO client.RMProxy: Connecting to ResourceManager at nnode/192.168.137.117:8032
15/11/29 00:20:38 INFO input.FileInputFormat: Total input paths to process : 2
15/11/29 00:20:39 INFO mapreduce.JobSubmitter: number of splits:2
15/11/29 00:20:39 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1448694510754_0004
15/11/29 00:20:39 INFO impl.YarnClientImpl: Submitted application application_1448694510754_0004
15/11/29 00:20:39 INFO mapreduce.Job: The url to track the job: http://nnode:8088/proxy/application_1448694510754_0004/
15/11/29 00:20:39 INFO mapreduce.Job: Running job: job_1448694510754_0004
15/11/29 00:21:10 INFO mapreduce.Job: Job job_1448694510754_0004 running in uber mode : false
15/11/29 00:21:10 INFO mapreduce.Job:map 0% reduce 0%
15/11/29 00:21:41 INFO mapreduce.Job:map 100% reduce 0%
15/11/29 00:22:01 INFO mapreduce.Job:map 100% reduce 100%
15/11/29 00:22:02 INFO mapreduce.Job: Job job_1448694510754_0004 completed successfully
15/11/29 00:22:02 INFO mapreduce.Job: Counters: 49
File System Counters
FILE: Number of bytes read=134
FILE: Number of bytes written=323865
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=271
HDFS: Number of bytes written=55
HDFS: Number of read operations=9
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=2
Launched reduce tasks=1
Data-local map tasks=2
Total time spent by all maps in occupied slots (ms)=55944
Total time spent by all reduces in occupied slots (ms)=17867
Total time spent by all map tasks (ms)=55944
Total time spent by all reduce tasks (ms)=17867
Total vcore-seconds taken by all map tasks=55944
Total vcore-seconds taken by all reduce tasks=17867
Total megabyte-seconds taken by all map tasks=57286656
Total megabyte-seconds taken by all reduce tasks=18295808
Map-Reduce Framework
Map input records=6
Map output records=12
Map output bytes=170
Map output materialized bytes=140
Input split bytes=188
Combine input records=12
Combine output records=8
Reduce input groups=7
Reduce shuffle bytes=140
Reduce input records=8
Reduce output records=7
Spilled Records=16
Shuffled Maps =2
Failed Shuffles=0
Merged Map outputs=2
GC time elapsed (ms)=315
CPU time spent (ms)=2490
Physical memory (bytes) snapshot=510038016
Virtual memory (bytes) snapshot=2541662208
Total committed heap usage (bytes)=257171456
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=83
File Output Format Counters
Bytes Written=55
$
页:
[1]