org.apache.pig.builtin

Class ParquetStorer

java.lang.Object

org.apache.pig.StoreFuncWrapper

org.apache.pig.StoreFuncMetadataWrapper

org.apache.pig.builtin.ParquetStorer

All Implemented Interfaces:

StoreFuncInterface, StoreMetadata, StoreResources

public class ParquetStorer
extends StoreFuncMetadataWrapper
implements StoreResources

Wrapper class which will delegate calls to org.apache.parquet.pig.ParquetStorer

Constructor Summary

Constructors

Constructor and Description
ParquetStorer()

Method Summary

Modifier and Type	Method and Description
java.util.List<java.lang.String>	getCacheFiles() Allow a StoreFunc to specify a list of files it would like placed in the distributed cache.
java.util.List<java.lang.String>	getShipFiles() Allow a StoreFunc to specify a list of files located locally and would like to ship to backend (through distributed cache).
void	setStoreLocation(java.lang.String location, org.apache.hadoop.mapreduce.Job job) Communicate to the storer the location where the data needs to be stored.

Methods inherited from class org.apache.pig.StoreFuncMetadataWrapper

setStoreFunc, storeSchema, storeStatistics

Methods inherited from class org.apache.pig.StoreFuncWrapper

checkSchema, cleanupOnFailure, cleanupOnSuccess, getMethodName, getOutputFormat, prepareToWrite, putNext, relToAbsPathForStoreLocation, setStoreFunc, setStoreFuncUDFContextSignature

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetStorer

public ParquetStorer()
              throws FrontendException

Throws:

FrontendException

Method Detail

setStoreLocation

public void setStoreLocation(java.lang.String location,
                             org.apache.hadoop.mapreduce.Job job)
                      throws java.io.IOException

Communicate to the storer the location where the data needs to be stored. The location string passed to the StoreFuncInterface here is the return value of StoreFuncInterface.relToAbsPathForStoreLocation(String, Path) This method will be called in the frontend and backend multiple times. Implementations should bear in mind that this method is called multiple times and should ensure there are no inconsistent side effects due to the multiple calls. StoreFuncInterface.checkSchema(ResourceSchema) will be called before any call to StoreFuncInterface.setStoreLocation(String, Job).

Specified by:

setStoreLocation in interface StoreFuncInterface

Overrides:

setStoreLocation in class StoreFuncWrapper

Parameters:

location - Location returned by StoreFuncInterface.relToAbsPathForStoreLocation(String, Path)

job - The Job object

Throws:

java.io.IOException - if the location is not valid.

getCacheFiles

public java.util.List<java.lang.String> getCacheFiles()

Description copied from interface: StoreResources

Allow a StoreFunc to specify a list of files it would like placed in the distributed cache. The default implementation returns null.

Specified by:

getCacheFiles in interface StoreResources

Returns:

A list of files

getShipFiles

public java.util.List<java.lang.String> getShipFiles()

Description copied from interface: StoreResources

Allow a StoreFunc to specify a list of files located locally and would like to ship to backend (through distributed cache). Check for FuncUtils for utility function to facilitate it The default implementation returns null.

Specified by:

getShipFiles in interface StoreResources

Returns:

A list of files