Hadoop2.6.0学习笔记（三）Hadoop序列化
$ hadoop jar WRApp.jar /data/HTTP_SITE_FLOW.log /20151129140415/11/29 14:44:13 INFO client.RMProxy: Connecting to ResourceManager at nnode/192.168.137.117:8032
15/11/29 14:44:15 INFO input.FileInputFormat: Total input paths to process : 1
15/11/29 14:44:15 INFO mapreduce.JobSubmitter: number of splits:1
15/11/29 14:44:15 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1448763754600_0004
15/11/29 14:44:15 INFO impl.YarnClientImpl: Submitted application application_1448763754600_0004
15/11/29 14:44:15 INFO mapreduce.Job: The url to track the job: http://nnode:8088/proxy/application_1448763754600_0004/
15/11/29 14:44:15 INFO mapreduce.Job: Running job: job_1448763754600_0004
15/11/29 14:44:45 INFO mapreduce.Job: Job job_1448763754600_0004 running in uber mode : false
15/11/29 14:44:45 INFO mapreduce.Job:map 0% reduce 0%
15/11/29 14:45:14 INFO mapreduce.Job:map 100% reduce 0%
15/11/29 14:45:34 INFO mapreduce.Job:map 100% reduce 100%
15/11/29 14:45:34 INFO mapreduce.Job: Job job_1448763754600_0004 completed successfully
15/11/29 14:45:34 INFO mapreduce.Job: Counters: 49
File System Counters
FILE: Number of bytes read=254
FILE: Number of bytes written=216031
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=277
HDFS: Number of bytes written=107
HDFS: Number of read operations=6
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Launched reduce tasks=1
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=27010
Total time spent by all reduces in occupied slots (ms)=16429
Total time spent by all map tasks (ms)=27010
Total time spent by all reduce tasks (ms)=16429
Total vcore-seconds taken by all map tasks=27010
Total vcore-seconds taken by all reduce tasks=16429
Total megabyte-seconds taken by all map tasks=27658240
Total megabyte-seconds taken by all reduce tasks=16823296
Map-Reduce Framework
Map input records=8
Map output records=8
Map output bytes=232
Map output materialized bytes=254
Input split bytes=103
Combine input records=0
Combine output records=0
Reduce input groups=5
Reduce shuffle bytes=254
Reduce input records=8
Reduce output records=5
Spilled Records=16
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=167
CPU time spent (ms)=2320
Physical memory (bytes) snapshot=304205824
Virtual memory (bytes) snapshot=1695969280
Total committed heap usage (bytes)=136450048
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=174
File Output Format Counters
Bytes Written=107
$
页:
[1]