flume线上配置的示例分析

这篇文章主要介绍了flume线上配置的示例分析，具有一定借鉴价值，感兴趣的朋友可以参考下，希望大家阅读完这篇文章之后大有收获，下面让小编带着大家一起了解一下。hdfs_agent.sources = r1hdfs_agent.sinks = k1hdfs_agent.channels = c1# Describe/configure the sourcehdfs_agent.sources.r1.type = org.apache.flume.source.kafka.KafkaSource#hdfs_agent.sources.r1.zookeeperConnect = 10.69.40.17:2181,10.69.40.12:2181,10.69.40.7:2181,10.69.40.11:2181,10.69.40.16:2181#hdfs_agent.sources.r1.groupId = online_kafka_to_hdfs_gk_groupid_000001#hdfs_agent.sources.r1.topic = IRT_Dev_Status_STDhdfs_agent.sources.r1.kafka.bootstrap.servers = 10.69.40.10:9092,10.69.40.13:9 香港云主机092,10.69.40.14:9092,10.69.40.15:9092hdfs_agent.sources.r1.kafka.consumer.group.id = online_kafka_to_hdfs_gk_groupid_000001hdfs_agent.sources.r1.kafka.topics = workcondition_info_flumehdfs_agent.sources.r1.batchSize = 2000hdfs_agent.sources.r1.interceptors = i1hdfs_agent.sources.r1.interceptors.i1.type = host# Describe the sinkhdfs_agent.sinks.k1.type = hdfshdfs_agent.sinks.k1.hdfs.path = hdfs://rootcloud/ods/%Y%m%d/%Hhdfs_agent.sinks.k1.hdfs.filePrefix = log-%{host}hdfs_agent.sinks.k1.hdfs.fileType = DataStreamhdfs_agent.sinks.k1.hdfs.rollInterval = 3600hdfs_agent.sinks.k1.hdfs.rollSize = 104857600hdfs_agent.sinks.k1.hdfs.rollCount = 0hdfs_agent.sinks.k1.hdfs.batchSize = 2000hdfs_agent.sinks.k1.hdfs.callTimeout = 300000hdfs_agent.sinks.k1.hdfs.idleTimeout = 600# Use a channel which buffers events in memoryhdfs_agent.channels.c1.type = memoryhdfs_agent.channels.c1.capacity = 2000000hdfs_agent.channels.c1.transactionCapacity = 3000# Bind the source and sink to the channelhdfs_agent.sources.r1.channels = c1hdfs_agent.sinks.k1.channel = c1感谢你能够认真阅读完这篇文章，希望小编分享的“flume线上配置的示例分析”这篇文章对大家有帮助，同时也希望大家多多支持开发云，关注开发云行业资讯频道，更多相关知识等着你来学习!

相关推荐: github contribbution没记录怎么办

github contribbution没记录怎么办，针对这个问题，这篇文章详细介绍了相对应的分析和解答，希望可以帮助更多想解决这个问题的小伙伴找到更简单易行的方法。长期使用GitHub托管代码的小伙伴可能有发现，有时候写了几天的代码，但是发现contribb…