[hadoop读书笔记] 第十五章 sqoop1.4.6小实验

clh899

[hadoop@hadoop-allinone-200-123 sqoop-1.4.6]$ sqoop import --connect jdbc:mysql://192.168.200.250/sqoop --tabgets -m 1 -username root -password weidong　　
Warning: /wdcloud/app/sqoop-1.4.6/../hbase does not exist! HBase imports will fail.
　　
Please set $HBASE_HOME to the root of your HBase installation.
　　
Warning: /wdcloud/app/sqoop-1.4.6/../hcatalog does not exist! HCatalog jobs will fail.
　　
Please set $HCAT_HOME to the root of your HCatalog installation.
　　
Warning: /wdcloud/app/sqoop-1.4.6/../accumulo does not exist! Accumulo imports will fail.
　　
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
　　
Warning: /wdcloud/app/sqoop-1.4.6/../zookeeper does not exist! Accumulo imports will fail.
　　
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
　　
17/01/23 23:59:17 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
　　
17/01/23 23:59:17 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider us instead.
　　
17/01/23 23:59:18 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
　　
17/01/23 23:59:18 INFO tool.CodeGenTool: Beginning code generation
　　
17/01/23 23:59:18 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
　　
17/01/23 23:59:18 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
　　
17/01/23 23:59:18 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /wdcloud/app/hadoop-2.7.3
　　
Note: /tmp/sqoop-hadoop/compile/591fd797fbbe57ce38b4492a1c9a0300/widgets.java uses or overrides a deprecated
　　
Note: Recompile with -Xlint:deprecation for details.
　　
17/01/23 23:59:21 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/591fd797fbbe57ce381c9a0300/widgets.jar
　　
17/01/23 23:59:21 WARN manager.MySQLManager:It looks like you are importing frommysql.
　　
17/01/23 23:59:21 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
　　
17/01/23 23:59:21 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
　　
17/01/23 23:59:21 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
　　
17/01/23 23:59:21 INFO mapreduce.ImportJobBase: Beginning import of widgets
　　
17/01/23 23:59:21 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.joer.address
　　
17/01/23 23:59:22 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
　　
17/01/23 23:59:23 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.
　　
17/01/23 23:59:24 INFO client.RMProxy: Connecting to ResourceManager at hadoop-allinone-200-123.wdcloud.locl/8.200.123:8032
　　
17/01/23 23:59:30 INFO db.DBInputFormat: Using read commited transaction isolation
　　
17/01/23 23:59:30 INFO mapreduce.JobSubmitter: number of splits:1
　　
17/01/23 23:59:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485230213604_0001
　　
17/01/23 23:59:32 INFO impl.YarnClientImpl: Submitted application application_1485230213604_0001
　　
17/01/23 23:59:32 INFO mapreduce.Job: The url to track the job: http://hadoop-allinone-200-123.wdcloud.locl:80213604_0001/
　　
17/01/23 23:59:32 INFO mapreduce.Job: Running job: job_1485230213604_0001
　　
17/01/23 23:59:50 INFO mapreduce.Job: Job job_1485230213604_0001 running in uber mode : false
　　
17/01/23 23:59:50 INFO mapreduce.Job:  map 0% reduce 0%
　　
17/01/24 00:00:00 INFO mapreduce.Job:  map 100% reduce 0%
　　
17/01/24 00:00:01 INFO mapreduce.Job: Job job_1485230213604_0001 completed successfully
　　
17/01/24 00:00:02 INFO mapreduce.Job: Counters: 30
　　
File System Counters
　　
FILE: Number of bytes read=0
　　
FILE: Number of bytes written=138186
　　
FILE: Number of read operations=0
　　
FILE: Number of large read operations=0
　　
FILE: Number of write operations=0
　　
HDFS: Number of bytes read=87
　　
HDFS: Number of bytes written=129
　　
HDFS: Number of read operations=4
　　
HDFS: Number of large read operations=0
　　
HDFS: Number of write operations=2
　　
Job Counters
　　
Launched map tasks=1
　　
Other local map tasks=1
　　
Total time spent by all maps in occupied slots (ms)=7933
　　
Total time spent by all reduces in occupied slots (ms)=0
　　
Total time spent by all map tasks (ms)=7933
　　
Total vcore-milliseconds taken by all map tasks=7933
　　
Total megabyte-milliseconds taken by all map tasks=8123392
　　
Map-Reduce Framework
　　
Map input records=3
　　
Map output records=3
　　
Input split bytes=87
　　
Spilled Records=0
　　
Failed Shuffles=0
　　
Merged Map outputs=0
　　
GC time elapsed (ms)=59
　　
CPU time spent (ms)=2210
　　
Physical memory (bytes) snapshot=190287872
　　
Virtual memory (bytes) snapshot=2924978176
　　
Total committed heap usage (bytes)=220725248
　　
File Input Format Counters
　　
Bytes Read=0
　　
File Output Format Counters
　　
Bytes Written=129
　　
17/01/24 00:00:02 INFO mapreduce.ImportJobBase: Transferred 129 bytes in 38.2028 seconds (3.3767 bytes/sec)
　　
17/01/24 00:00:02 INFO mapreduce.ImportJobBase: Retrieved 3 records.