org.apache.paimon.spark.sort

Class SparkZOrderUDF

java.lang.Object

org.apache.paimon.spark.sort.SparkZOrderUDF

All Implemented Interfaces:

Serializable

public class SparkZOrderUDF
extends Object
implements Serializable

Spark udf to calculate zorder bytes. Copied from iceberg.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SparkZOrderUDF(int numCols, int varTypeSize, int maxOutputSize)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.sql.Column	interleaveBytes(org.apache.spark.sql.Column arrayBinary)
org.apache.spark.sql.Column	sortedLexicographically(org.apache.spark.sql.Column column, org.apache.spark.sql.types.DataType type)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkZOrderUDF

public SparkZOrderUDF(int numCols,
                      int varTypeSize,
                      int maxOutputSize)

Method Detail

interleaveBytes

public org.apache.spark.sql.Column interleaveBytes(org.apache.spark.sql.Column arrayBinary)

sortedLexicographically

public org.apache.spark.sql.Column sortedLexicographically(org.apache.spark.sql.Column column,
                                                           org.apache.spark.sql.types.DataType type)