@InterfaceAudience.Public
@InterfaceStability.Evolving
public class KuduSink
extends org.apache.flume.sink.AbstractSink
implements org.apache.flume.conf.Configurable
A Flume sink that reads events from a channel and writes them to a Kudu table.
Flume Kudu Sink configuration parameters
| Property Name | Default | Required? | Description |
|---|---|---|---|
| channel | Yes | The name of the Flume channel to read from. | |
| type | Yes | Component name. Must be org.apache.kudu.flume.sink.KuduSink | |
| masterAddresses | Yes | Comma-separated list of "host:port" Kudu master addresses. The port is optional. | |
| tableName | Yes | The name of the Kudu table to write to. | |
| batchSize | 100 | No | The maximum number of events the sink will attempt to take from the channel per transaction. |
| ignoreDuplicateRows | true | No | Whether to ignore duplicate primary key errors caused by inserts. |
| timeoutMillis | 10000 | No | Timeout period for Kudu write operations, in milliseconds. |
| producer | SimpleKuduOperationsProducer | No | The fully qualified class name of the KuduOperationsProducer the sink should use. |
| producer.* | (Varies by operations producer) | Configuration properties to pass to the operations producer implementation. |
Installation
After building the sink, in order to use it with Flume, place the file named kudu-flume-sink-VERSION-jar-with-dependencies.jar in the Flume plugins.d directory under kudu-flume-sink/lib/.
For detailed instructions on using Flume's plugins.d mechanism, please see the plugins.d section of the Flume User Guide.
| Constructor and Description |
|---|
KuduSink() |
KuduSink(KuduClient kuduClient) |
| Modifier and Type | Method and Description |
|---|---|
void |
configure(org.apache.flume.Context context) |
KuduClient |
getClient() |
org.apache.flume.Sink.Status |
process() |
void |
start() |
void |
stop() |
public KuduSink()
@InterfaceAudience.Private public KuduSink(KuduClient kuduClient)
public void start()
start in interface org.apache.flume.lifecycle.LifecycleAwarestart in class org.apache.flume.sink.AbstractSinkpublic void stop()
stop in interface org.apache.flume.lifecycle.LifecycleAwarestop in class org.apache.flume.sink.AbstractSinkpublic void configure(org.apache.flume.Context context)
configure in interface org.apache.flume.conf.Configurablepublic KuduClient getClient()
public org.apache.flume.Sink.Status process()
throws org.apache.flume.EventDeliveryException
process in interface org.apache.flume.Sinkorg.apache.flume.EventDeliveryExceptionCopyright © 2016 The Apache Software Foundation. All rights reserved.