org.apache.paimon.hive.mapred

Class TezUtil

java.lang.Object

org.apache.paimon.hive.mapred.TezUtil

public class TezUtil
extends Object

Utility class to enrich the JobContext and TaskAttemptContext with the vertex id.

Method Summary

Modifier and Type	Method and Description
static org.apache.hadoop.mapred.TaskAttemptContext	enrichContextWithAttemptWrapper(org.apache.hadoop.mapred.TaskAttemptContext taskAttemptContext) Creates a new taskAttemptContext by replacing the taskAttemptID with a wrapped object.
static org.apache.hadoop.mapred.JobContext	enrichContextWithVertexId(org.apache.hadoop.mapred.JobContext jobContext) If the Tez vertex id is present in config, creates a new jobContext by appending the Tez vertex id to the jobID.
static org.apache.hadoop.mapred.TaskAttemptID	taskAttemptWrapper(org.apache.hadoop.mapred.JobConf jc)
static org.apache.hadoop.mapred.TaskAttemptID	taskAttemptWrapper(org.apache.hadoop.mapred.TaskAttemptID attemptID)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

enrichContextWithVertexId

public static org.apache.hadoop.mapred.JobContext enrichContextWithVertexId(org.apache.hadoop.mapred.JobContext jobContext)

If the Tez vertex id is present in config, creates a new jobContext by appending the Tez vertex id to the jobID. For the rationale behind this enrichment, please refer to point #1 in the docs of TaskAttemptWrapper.

Parameters:

jobContext - original jobContext to be enriched

Returns:

enriched jobContext

enrichContextWithAttemptWrapper

public static org.apache.hadoop.mapred.TaskAttemptContext enrichContextWithAttemptWrapper(org.apache.hadoop.mapred.TaskAttemptContext taskAttemptContext)

Creates a new taskAttemptContext by replacing the taskAttemptID with a wrapped object. For the rationale behind this enrichment, please refer to point #2 in the docs of TaskAttemptWrapper.

Parameters:

taskAttemptContext - original taskAttemptContext to be enriched

Returns:

enriched taskAttemptContext

taskAttemptWrapper

public static org.apache.hadoop.mapred.TaskAttemptID taskAttemptWrapper(org.apache.hadoop.mapred.TaskAttemptID attemptID)

taskAttemptWrapper

public static org.apache.hadoop.mapred.TaskAttemptID taskAttemptWrapper(org.apache.hadoop.mapred.JobConf jc)