ienki 发表于 2015-9-17 09:08:02

Flume 散乱汇总

  
  1. 启动命令中 no-reload-conf 参数:没有此参数,会动态加载配置文件,默认每30秒加载一次配置文;有此参数,则只在启动时加载一次配置文件
  
  
  
  hdfs sink 压 . 缩
  

>> agent.sinks.lzo-hdfs-write.type = hdfs
>> agent.sinks.lzo-hdfs-write.hdfs.path = hdfs://10.34.4.55:8020/tmp/
>> agent.sinks.lzo-hdfs-write.hdfs.filePrefix = test%Y
>> agent.sinks.lzo-hdfs-write.channel = lzo-memory-channel
>> agent.sinks.lzo-hdfs-write.hdfs.rollInterval = 3600
>> agent.sinks.lzo-hdfs-write.hdfs.rollSize = 209715200
>> agent.sinks.lzo-hdfs-write.hdfs.rollCount = 0
>> agent.sinks.lzo-hdfs-write.hdfs.batchSize = 1000
>> agent.sinks.lzo-hdfs-write.hdfs.codeC = lzo
>> agent.sinks.lzo-hdfs-write.hdfs.fileType = CompressedStream
页: [1]
查看完整版本: Flume 散乱汇总