@InterfaceAudience.Public
@InterfaceStability.Evolving
public class KuduSink
extends org.apache.flume.sink.AbstractSink
implements org.apache.flume.conf.Configurable
Flume Kudu Sink configuration parameters
Property Name | Default | Required? | Description |
---|---|---|---|
channel | Yes | The name of the Flume channel to read. | |
type | Yes | Component name. Must be org.apache.kudu.flume.sink.KuduSink | |
masterAddresses | Yes | Comma-separated list of "host:port" Kudu master addresses. The port is optional. | |
tableName | Yes | The name of the Kudu table to write to. | |
batchSize | 1000 | No | The maximum number of events the sink takes from the channel per transaction. |
ignoreDuplicateRows | true | No | Whether to ignore duplicate primary key errors caused by inserts. |
timeoutMillis | 10000 | No | Timeout period for Kudu write operations, in milliseconds. |
producer | SimpleKuduOperationsProducer | No | The fully-qualified class name of the KuduOperationsProducer
the sink should use. |
producer.* | (Varies by operations producer) | Configuration properties to pass to the operations producer implementation. |
Installation
After building the sink, in order to use it with Flume, place the file named kudu-flume-sink-VERSION-jar-with-dependencies.jar in the Flume plugins.d directory under kudu-flume-sink/lib/.
For detailed instructions on using Flume's plugins.d mechanism, please see the plugins.d section of the Flume User Guide.
Constructor and Description |
---|
KuduSink() |
KuduSink(KuduClient kuduClient) |
Modifier and Type | Method and Description |
---|---|
void |
configure(org.apache.flume.Context context) |
KuduClient |
getClient() |
org.apache.flume.Sink.Status |
process() |
void |
start() |
void |
stop() |
public KuduSink()
@InterfaceAudience.Private public KuduSink(KuduClient kuduClient)
public void start()
start
in interface org.apache.flume.lifecycle.LifecycleAware
start
in class org.apache.flume.sink.AbstractSink
public void stop()
stop
in interface org.apache.flume.lifecycle.LifecycleAware
stop
in class org.apache.flume.sink.AbstractSink
public void configure(org.apache.flume.Context context)
configure
in interface org.apache.flume.conf.Configurable
public KuduClient getClient()
public org.apache.flume.Sink.Status process() throws org.apache.flume.EventDeliveryException
process
in interface org.apache.flume.Sink
org.apache.flume.EventDeliveryException
Copyright © 2018 The Apache Software Foundation. All rights reserved.