flume:支持重命名、移动文件的roll file sink升级版

flume:支持重命名、移动文件的roll file sink升级版

flume一套日志收集系统,关于这套系统如何使用的文章网络上比较多,且官方手册也很详细,这里不再累赘。主要讨论关于flume自带的roll file sink弊端及升级方案。 flume自带的roll file sink用于在本地文件系统对文件进行持久化。flume仅仅提供了如下几个参数用来配置roll file sink: channel –   type – The component type name, needs to be file_roll. sink.directory – The directory where files will be stored sink.rollInterval 30 Roll the file every 30 seconds. Specifying 0 will disable rolling and cause all events to be written to a single file. sink.serializer TEXT
Continue reading flume:支持重命名、移动文件的roll file sink升级版