org.apache.paimon.hive.mapred

Class PaimonOutputCommitter

java.lang.Object

org.apache.hadoop.mapreduce.OutputCommitter

org.apache.hadoop.mapred.OutputCommitter

org.apache.paimon.hive.mapred.PaimonOutputCommitter

public class PaimonOutputCommitter
extends org.apache.hadoop.mapred.OutputCommitter

A Paimon table committer for adding data files to the Paimon table.

Constructor Summary

Constructors

Constructor and Description
PaimonOutputCommitter()

Method Summary

Modifier and Type	Method and Description
void	abortJob(org.apache.hadoop.mapred.JobContext originalContext, int status)
void	abortTask(org.apache.hadoop.mapred.TaskAttemptContext originalContext)
void	commitJob(org.apache.hadoop.mapred.JobContext originalContext)
void	commitTask(org.apache.hadoop.mapred.TaskAttemptContext originalContext)
boolean	needsTaskCommit(org.apache.hadoop.mapred.TaskAttemptContext taskAttemptContext)
void	setupJob(org.apache.hadoop.mapred.JobContext jobContext)
void	setupTask(org.apache.hadoop.mapred.TaskAttemptContext taskAttemptContext)

Methods inherited from class org.apache.hadoop.mapred.OutputCommitter

abortJob, abortTask, cleanupJob, cleanupJob, commitJob, commitTask, isCommitJobRepeatable, isCommitJobRepeatable, isRecoverySupported, isRecoverySupported, isRecoverySupported, needsTaskCommit, recoverTask, recoverTask, setupJob, setupTask

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PaimonOutputCommitter

public PaimonOutputCommitter()

Method Detail

setupJob

public void setupJob(org.apache.hadoop.mapred.JobContext jobContext)
              throws IOException

Specified by:

setupJob in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException

setupTask

public void setupTask(org.apache.hadoop.mapred.TaskAttemptContext taskAttemptContext)
               throws IOException

Specified by:

setupTask in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException

needsTaskCommit

public boolean needsTaskCommit(org.apache.hadoop.mapred.TaskAttemptContext taskAttemptContext)
                        throws IOException

Specified by:

needsTaskCommit in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException

commitTask

public void commitTask(org.apache.hadoop.mapred.TaskAttemptContext originalContext)
                throws IOException

Specified by:

commitTask in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException

abortTask

public void abortTask(org.apache.hadoop.mapred.TaskAttemptContext originalContext)
               throws IOException

Specified by:

abortTask in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException

commitJob

public void commitJob(org.apache.hadoop.mapred.JobContext originalContext)
               throws IOException

Overrides:

commitJob in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException

abortJob

public void abortJob(org.apache.hadoop.mapred.JobContext originalContext,
                     int status)
              throws IOException

Overrides:

abortJob in class org.apache.hadoop.mapred.OutputCommitter

Throws:

IOException