Flume - Is it possible to stop only a flume source?

2016-09-02T18:14:40

I've a flume memory channel and I want to know if exists a way to be sure that stopping a flume agent will not cause data loss on the channel.

A possible solution could be to stop the source, attend that the channel is flushed and then stop the agent.

Is there another way to stop a flume agent without loss data?

Thanks in advance

Copyright License:
Author:「Beniamino Del Pizzo」,Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.
Link to:https://stackoverflow.com/questions/39289931/flume-is-it-possible-to-stop-only-a-flume-source

About “Flume - Is it possible to stop only a flume source?” questions

I've a flume memory channel and I want to know if exists a way to be sure that stopping a flume agent will not cause data loss on the channel. A possible solution could be to stop the source, attend
I'm upgrading Flume1.7 to 1.9.I have 5 Kafka sources and 7 aws-s3's sinks in FLume's conf. Firstly I need stop Flume 1.7.So I execute the command 'kill ps -ef |grep flume |grep bidinfo | awk '{pr...
I want to use flume to transfert data from hdfs directory into directory in hdfs, in this transfer I want to apply processing morphline. For example: my source is "hdfs://localhost:8020/user/flume/
I'm trying to use Flume to ship my access logs to a Spark cluster. But there're a bunch of limitations that forces me to write a custom application (or a Flume source) to read the log files. What ...
I have created a custom source for flume and copied the jar files in the following locations : mkdir -p /usr/lib/flume-ng/plugins.d/MyFlumeSource/lib/MyFlumeSource.jar chown -R flume:flume /var...
I'm working with Flume 1.4.0, and I'm trying to stop Flume's components in a certain way: First, stop the sources. Then wait until all the events within the channels are consumed by the sinks. Onc...
I have a homegrown event collection and processing framework which i am looking to potentially replace with Apache Flume 1.2.0 as we are going to start loading data into Hadoop. Since Flume has no...
How to get source filename as it is from source into HDFS in flume? Ex: source file /usr/sample.txt hdfs: /tmp/sample.txt not like flumeevetns.23343.tmp how to stop appending timestamp and...
I am trying to configure an flume agent with custom source from here, I tried to run flume agent using command flume-ng agent --conf conf --conf-file conf/twitter1.conf --name TwitterAgent B...
I am trying to configure flume and am following this link. The following command works for me: flume-ng agent -n TwitterAgent -c conf -f /usr/lib/apache-flume-1.7.0-bin/conf/flume.conf The resul...

Copyright License:Reproduced under the CC 4.0 BY-SA copyright license with link to original source & disclaimer.