org.apache.pig.builtin

Class RoundRobinPartitioner

java.lang.Object

org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

org.apache.pig.builtin.RoundRobinPartitioner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

Deprecated.

@Deprecated
public class RoundRobinPartitioner
extends org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>
implements org.apache.hadoop.conf.Configurable

This partitioner should be used with extreme caution and only in cases where the order of output records is guaranteed to be same. If the order of output records can vary on retries which is mostly the case, map reruns due to shuffle fetch failures can lead to data being partitioned differently and result in incorrect output due to loss or duplication of data. Refer PIG-5041 for more details. This will be removed in the next release as it is risky to use in most cases.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	PIG_ROUND_ROBIN_PARTITIONER_BATCH_SIZE Deprecated. Batch size for round robin partitioning.

Constructor Summary

Constructors

Constructor and Description
RoundRobinPartitioner() Deprecated.

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf() Deprecated.
int	getPartition(org.apache.hadoop.io.Writable key, org.apache.hadoop.io.Writable value, int numPartitions) Deprecated.
void	setConf(org.apache.hadoop.conf.Configuration conf) Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PIG_ROUND_ROBIN_PARTITIONER_BATCH_SIZE

public static java.lang.String PIG_ROUND_ROBIN_PARTITIONER_BATCH_SIZE

Deprecated.

Batch size for round robin partitioning. Batch size number of records will be distributed to each partition in a round robin fashion. Default value is 0 which distributes each record in a circular fashion. Higher number for batch size can be used to increase probability of keeping similar records in the same partition if output is already sorted and get better compression.

Constructor Detail

RoundRobinPartitioner

public RoundRobinPartitioner()

Deprecated.

Method Detail

getPartition

public int getPartition(org.apache.hadoop.io.Writable key,
                        org.apache.hadoop.io.Writable value,
                        int numPartitions)

Deprecated.

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Deprecated.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Deprecated.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable