flume 示例一收集tomcat日志
例子场景描述：将tomcat的日志收集到指定的目录，tomcat 安装在/opt/tomcat, 日志存放在var/log/data。配置tomcat.conf 如下：
?1234567891011121314151617181920212223242526272829303132#A single-node Flume configuration #Name the components on this agent agent1.sources= source1agent1.sinks= sink1agent1.channels= channel1 #Describe/configure source1 agent1.sources.source1.type= execagent1.sources.source1.command= tail -n +0 -F /opt/tomcat/logs/ catalina.outagent1.sources.source1.channels= channel1#Describe sink1agent1.sinks.sink1.type= file_rollagent1.sinks.sink1.sink.directory=/var/log/data #Use a channel which buffers events in memoryagent1.channels.channel1.type= fileagent1.channels.channel1.checkpointDir=/var/checkpointagent1.channels.channel1.dataDirs=/var/tmpagent1.channels.channel1.capacity= 1000agent1.channels.channel1.transactionCapactiy= 100 #Bind the source and sink to the channelagent1.sources.source1.channels= channel1agent1.sinks.sink1.channel= channel1
运行agent
?1bin/flume-ngagent --conf conf --conf-file tomcat.conf --name agent1 -Dflume.root.logger=INFO,console
agent自动会将日志收集到指定的var/log/data
注意：hadoop-core-1.0.1.jar 放在flume 的lib目录中。否则报ClassNotFoundException
通过以上例子可以推广到收集apache server 、nginx日志
页:
[1]