@InterfaceAudience.Public @InterfaceStability.Evolving public class KuduTableOutputFormat extends org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,Operation> implements org.apache.hadoop.conf.Configurable
Use KuduTableMapReduceUtil.TableOutputFormatConfigurator
to correctly setup this output format, then KuduTableMapReduceUtil.getTableFromContext(org.apache.hadoop.mapreduce.TaskInputOutputContext)
to get a KuduTable.
Hadoop doesn't have the concept of "closing" the output format so in order to release the
resources we assume that once either
checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext)
or KuduTableOutputFormat.TableRecordWriter.close(org.apache.hadoop.mapreduce.TaskAttemptContext)
have been called that the object won't be used again and the KuduClient is shut down.
Constructor and Description |
---|
KuduTableOutputFormat() |
Modifier and Type | Method and Description |
---|---|
void |
checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext jobContext) |
org.apache.hadoop.conf.Configuration |
getConf() |
static KuduTable |
getKuduTable(String multitonKey) |
org.apache.hadoop.mapreduce.OutputCommitter |
getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) |
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,Operation> |
getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) |
void |
setConf(org.apache.hadoop.conf.Configuration entries) |
public void setConf(org.apache.hadoop.conf.Configuration entries)
setConf
in interface org.apache.hadoop.conf.Configurable
public org.apache.hadoop.conf.Configuration getConf()
getConf
in interface org.apache.hadoop.conf.Configurable
public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,Operation> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException, InterruptedException
getRecordWriter
in class org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,Operation>
IOException
InterruptedException
public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext jobContext) throws IOException, InterruptedException
checkOutputSpecs
in class org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,Operation>
IOException
InterruptedException
public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext taskAttemptContext) throws IOException, InterruptedException
getOutputCommitter
in class org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,Operation>
IOException
InterruptedException
Copyright © 2016 The Apache Software Foundation. All rights reserved.