Modifier and Type | Method and Description |
---|---|
protected PigStats |
PigServer.launchPlan(LogicalPlan lp,
java.lang.String jobName)
A common method for launching the jobs according to the logical plan
|
Constructor and Description |
---|
PigServer(ExecType execType) |
PigServer(ExecType execType,
org.apache.hadoop.conf.Configuration conf) |
PigServer(ExecType execType,
java.util.Properties properties) |
PigServer(PigContext context) |
PigServer(PigContext context,
boolean connect) |
PigServer(java.util.Properties properties) |
PigServer(java.lang.String execTypeString) |
PigServer(java.lang.String execTypeString,
java.util.Properties properties) |
Modifier and Type | Method and Description |
---|---|
java.lang.String |
ExecJob.getAlias()
Returns the alias of relation generated by this job
|
void |
ExecJob.getLogs(java.io.OutputStream log)
Collecting various forms of outputs
|
java.util.Iterator<Tuple> |
ExecJob.getResults()
if query has executed successfully we want to retrieve the results
via iterating over them.
|
void |
ExecJob.getSTDError(java.io.OutputStream error) |
void |
ExecJob.getSTDOut(java.io.OutputStream out) |
boolean |
ExecJob.hasCompleted()
true is the physical plan has executed successfully and results are ready
to be retrieved
|
void |
ExecutionEngine.init()
This method is responsible for the initialization of the ExecutionEngine.
|
void |
ExecJob.kill()
Kills current job.
|
PigStats |
ExecutionEngine.launchPig(LogicalPlan lp,
java.lang.String grpName,
PigContext pc)
This method is responsible for the actual execution of a LogicalPlan.
|
void |
ExecutionEngine.setConfiguration(java.util.Properties newConfiguration)
Responsible for updating the properties for the ExecutionEngine.
|
Modifier and Type | Method and Description |
---|---|
static byte |
HDataType.findTypeFromClassName(java.lang.String className) |
static byte |
HDataType.findTypeFromNullableWritable(PigNullableWritable o) |
static PigNullableWritable |
HDataType.getNewWritableComparable(byte keyType) |
static PigNullableWritable |
HDataType.getWritableComparable(java.lang.String className) |
static PigNullableWritable |
HDataType.getWritableComparableTypes(byte type) |
static PigNullableWritable |
HDataType.getWritableComparableTypes(java.lang.Object o,
byte keyType) |
Modifier and Type | Method and Description |
---|---|
protected java.util.Collection<org.apache.accumulo.core.data.Mutation> |
AccumuloStorage.getMutations(Tuple tuple) |
protected abstract java.util.Collection<org.apache.accumulo.core.data.Mutation> |
AbstractAccumuloStorage.getMutations(Tuple tuple) |
void |
AbstractAccumuloStorage.putNext(Tuple tuple) |
Modifier and Type | Method and Description |
---|---|
java.lang.String |
HJob.getAlias() |
org.apache.hadoop.mapred.JobConf |
HExecutionEngine.getExecConf(java.util.Properties properties) |
void |
HJob.getLogs(java.io.OutputStream log) |
java.util.Iterator<Tuple> |
HJob.getResults() |
org.apache.hadoop.mapred.JobConf |
HExecutionEngine.getS3Conf() |
void |
HJob.getSTDError(java.io.OutputStream error) |
void |
HJob.getSTDOut(java.io.OutputStream out) |
boolean |
HJob.hasCompleted() |
void |
HExecutionEngine.init() |
void |
HJob.kill() |
PigStats |
HExecutionEngine.launchPig(LogicalPlan lp,
java.lang.String grpName,
PigContext pc) |
void |
HExecutionEngine.setConfiguration(java.util.Properties newConfiguration) |
Modifier and Type | Method and Description |
---|---|
PigStats |
MapReduceLauncher.launchPig(PhysicalPlan php,
java.lang.String grpName,
PigContext pc) |
Constructor and Description |
---|
MergeJoinIndexer(java.lang.String funcSpec,
java.lang.String innerPlan,
java.lang.String serializedPhyPlan,
java.lang.String udfCntxtSignature,
java.lang.String scope,
java.lang.String ignoreNulls) |
Modifier and Type | Method and Description |
---|---|
protected float[] |
WeightedRangePartitioner.getProbVec(Tuple values) |
Modifier and Type | Method and Description |
---|---|
Result |
PhysicalOperator.getNext(byte dataType)
Implementations that call into the different versions of getNext are often
identical, differing only in the signature of the getNext() call they make.
|
Result |
PhysicalOperator.getNextBigDecimal() |
Result |
PhysicalOperator.getNextBigInteger() |
Result |
PhysicalOperator.getNextBoolean() |
Result |
PhysicalOperator.getNextDataBag() |
Result |
PhysicalOperator.getNextDataByteArray() |
Result |
PhysicalOperator.getNextDateTime() |
Result |
PhysicalOperator.getNextDouble() |
Result |
PhysicalOperator.getNextFloat() |
Result |
PhysicalOperator.getNextInteger() |
Result |
PhysicalOperator.getNextLong() |
Result |
PhysicalOperator.getNextMap() |
Result |
PhysicalOperator.getNextString() |
Result |
PhysicalOperator.getNextTuple() |
Result |
PhysicalOperator.processInput()
A generic method for parsing input that either returns the attached input
if it exists or fetches it from its predecessor.
|
Modifier and Type | Method and Description |
---|---|
protected Result |
ExpressionOperator.accumChild(java.util.List<ExpressionOperator> child,
byte dataType)
Drive all the UDFs in accumulative mode
|
protected java.lang.Number |
Add.add(java.lang.Number a,
java.lang.Number b,
byte dataType) |
protected Result |
POProject.consumeInputBag(Result input) |
protected java.lang.Number |
Divide.divide(java.lang.Number a,
java.lang.Number b,
byte dataType) |
protected boolean |
Divide.equalsZero(java.lang.Number a,
byte dataType) |
protected Result |
Subtract.genericGetNext(byte dataType) |
Result |
POBinCond.genericGetNext(byte dataType) |
protected Result |
Multiply.genericGetNext(byte dataType) |
protected Result |
Mod.genericGetNext(byte dataType) |
protected Result |
Divide.genericGetNext(byte dataType) |
protected Result |
Add.genericGetNext(byte dataType) |
int |
POProject.getColumn() |
java.lang.String |
POUserFunc.getFinal() |
java.lang.String |
POUserFunc.getInitial() |
java.lang.String |
POUserFunc.getIntermed() |
Result |
POProject.getNext()
Fetches the input tuple and returns the requested
column
|
Result |
Subtract.getNextBigDecimal() |
Result |
POUserFunc.getNextBigDecimal() |
Result |
POUserComparisonFunc.getNextBigDecimal() |
Result |
POProject.getNextBigDecimal() |
Result |
PONegative.getNextBigDecimal() |
Result |
POCast.getNextBigDecimal() |
Result |
POBinCond.getNextBigDecimal() |
Result |
Multiply.getNextBigDecimal() |
Result |
Divide.getNextBigDecimal() |
Result |
ConstantExpression.getNextBigDecimal() |
Result |
Add.getNextBigDecimal() |
Result |
Subtract.getNextBigInteger() |
Result |
POUserFunc.getNextBigInteger() |
Result |
POUserComparisonFunc.getNextBigInteger() |
Result |
POProject.getNextBigInteger() |
Result |
PONegative.getNextBigInteger() |
Result |
POCast.getNextBigInteger() |
Result |
POBinCond.getNextBigInteger() |
Result |
Multiply.getNextBigInteger() |
Result |
Mod.getNextBigInteger() |
Result |
Divide.getNextBigInteger() |
Result |
ConstantExpression.getNextBigInteger() |
Result |
Add.getNextBigInteger() |
Result |
POUserFunc.getNextBoolean() |
Result |
POUserComparisonFunc.getNextBoolean() |
Result |
PORegexp.getNextBoolean() |
Result |
POProject.getNextBoolean() |
Result |
POOr.getNextBoolean() |
Result |
PONot.getNextBoolean() |
Result |
POMapLookUp.getNextBoolean() |
Result |
POIsNull.getNextBoolean() |
Result |
POCast.getNextBoolean() |
Result |
POBinCond.getNextBoolean() |
Result |
POAnd.getNextBoolean() |
Result |
NotEqualToExpr.getNextBoolean() |
Result |
LessThanExpr.getNextBoolean() |
Result |
LTOrEqualToExpr.getNextBoolean() |
Result |
GreaterThanExpr.getNextBoolean() |
Result |
GTOrEqualToExpr.getNextBoolean() |
Result |
EqualToExpr.getNextBoolean() |
Result |
ConstantExpression.getNextBoolean() |
Result |
ComparisonOperator.getNextBoolean() |
Result |
POUserFunc.getNextDataBag() |
Result |
POUserComparisonFunc.getNextDataBag() |
Result |
PORelationToExprProject.getNextDataBag() |
Result |
POProject.getNextDataBag() |
Result |
POMapLookUp.getNextDataBag() |
Result |
POCast.getNextDataBag() |
Result |
POBinCond.getNextDataBag() |
Result |
ExpressionOperator.getNextDataBag() |
Result |
ConstantExpression.getNextDataBag() |
Result |
ComparisonOperator.getNextDataBag() |
Result |
POUserFunc.getNextDataByteArray() |
Result |
POUserComparisonFunc.getNextDataByteArray() |
Result |
POProject.getNextDataByteArray() |
Result |
POMapLookUp.getNextDataByteArray() |
Result |
POCast.getNextDataByteArray() |
Result |
POBinCond.getNextDataByteArray() |
Result |
ConstantExpression.getNextDataByteArray() |
Result |
ComparisonOperator.getNextDataByteArray() |
Result |
POUserFunc.getNextDateTime() |
Result |
POUserComparisonFunc.getNextDateTime() |
Result |
POProject.getNextDateTime() |
Result |
POMapLookUp.getNextDateTime() |
Result |
POCast.getNextDateTime() |
Result |
POBinCond.getNextDateTime() |
Result |
ConstantExpression.getNextDateTime() |
Result |
ComparisonOperator.getNextDateTime() |
Result |
Subtract.getNextDouble() |
Result |
POUserFunc.getNextDouble() |
Result |
POUserComparisonFunc.getNextDouble() |
Result |
POProject.getNextDouble() |
Result |
PONegative.getNextDouble() |
Result |
POMapLookUp.getNextDouble() |
Result |
POCast.getNextDouble() |
Result |
POBinCond.getNextDouble() |
Result |
Multiply.getNextDouble() |
Result |
Divide.getNextDouble() |
Result |
ConstantExpression.getNextDouble() |
Result |
ComparisonOperator.getNextDouble() |
Result |
Add.getNextDouble() |
Result |
Subtract.getNextFloat() |
Result |
POUserFunc.getNextFloat() |
Result |
POUserComparisonFunc.getNextFloat() |
Result |
POProject.getNextFloat() |
Result |
PONegative.getNextFloat() |
Result |
POMapLookUp.getNextFloat() |
Result |
POCast.getNextFloat() |
Result |
POBinCond.getNextFloat() |
Result |
Multiply.getNextFloat() |
Result |
Divide.getNextFloat() |
Result |
ConstantExpression.getNextFloat() |
Result |
ComparisonOperator.getNextFloat() |
Result |
Add.getNextFloat() |
Result |
Subtract.getNextInteger() |
Result |
POUserFunc.getNextInteger() |
Result |
POUserComparisonFunc.getNextInteger() |
Result |
POProject.getNextInteger() |
Result |
PONegative.getNextInteger() |
Result |
POMapLookUp.getNextInteger() |
Result |
POCast.getNextInteger() |
Result |
POBinCond.getNextInteger() |
Result |
Multiply.getNextInteger() |
Result |
Mod.getNextInteger() |
Result |
Divide.getNextInteger() |
Result |
ConstantExpression.getNextInteger() |
Result |
ComparisonOperator.getNextInteger() |
Result |
Add.getNextInteger() |
Result |
Subtract.getNextLong() |
Result |
POUserFunc.getNextLong() |
Result |
POUserComparisonFunc.getNextLong() |
Result |
POProject.getNextLong() |
Result |
PONegative.getNextLong() |
Result |
POMapLookUp.getNextLong() |
Result |
POCast.getNextLong() |
Result |
POBinCond.getNextLong() |
Result |
Multiply.getNextLong() |
Result |
Mod.getNextLong() |
Result |
Divide.getNextLong() |
Result |
ConstantExpression.getNextLong() |
Result |
ComparisonOperator.getNextLong() |
Result |
Add.getNextLong() |
Result |
POUserFunc.getNextMap() |
Result |
POUserComparisonFunc.getNextMap() |
Result |
POProject.getNextMap() |
Result |
POMapLookUp.getNextMap() |
Result |
POCast.getNextMap() |
Result |
POBinCond.getNextMap() |
Result |
ConstantExpression.getNextMap() |
Result |
ComparisonOperator.getNextMap() |
Result |
POUserFunc.getNextString() |
Result |
POUserComparisonFunc.getNextString() |
Result |
POProject.getNextString() |
Result |
POMapLookUp.getNextString() |
Result |
POCast.getNextString() |
Result |
POBinCond.getNextString() |
Result |
ConstantExpression.getNextString() |
Result |
ComparisonOperator.getNextString() |
Result |
POUserFunc.getNextTuple() |
Result |
POUserComparisonFunc.getNextTuple() |
Result |
POProject.getNextTuple()
Asked for Tuples.
|
Result |
POMapLookUp.getNextTuple() |
Result |
POCast.getNextTuple() |
Result |
POBinCond.getNextTuple() |
Result |
ConstantExpression.getNextTuple() |
Result |
ComparisonOperator.getNextTuple() |
java.lang.reflect.Type |
POUserFunc.getOriginalReturnType() |
protected java.lang.Number |
Mod.mod(java.lang.Number a,
java.lang.Number b,
byte dataType) |
protected java.lang.Number |
Multiply.multiply(java.lang.Number a,
java.lang.Number b,
byte dataType) |
Result |
POUserFunc.processInput() |
Result |
POMapLookUp.processInput() |
protected Result |
POProject.processInputBag() |
void |
POUserFunc.setAlgebraicFunction(byte Function) |
protected java.lang.Number |
Subtract.subtract(java.lang.Number a,
java.lang.Number b,
byte dataType) |
Modifier and Type | Method and Description |
---|---|
protected Result |
POCounter.addCounterValue(Result input)
Add current task id and local counter value.
|
Result |
PORank.addRank(Result input)
Reads the output tuple from POCounter and the cumulative sum previously calculated.
|
void |
Packager.attachInput(java.lang.Object key,
DataBag[] bags,
boolean[] readOnce) |
void |
LitePackager.attachInput(java.lang.Object key,
DataBag[] bags,
boolean[] readOnce) |
void |
JoinPackager.attachInput(java.lang.Object key,
DataBag[] bags,
boolean[] readOnce) |
void |
CombinerPackager.attachInput(java.lang.Object key,
DataBag[] bags,
boolean[] readOnce) |
protected Tuple |
POLocalRearrange.constructLROutput(java.util.List<Result> resLst,
java.util.List<Result> secondaryResLst,
Tuple value) |
protected Tuple |
POPreCombinerLocalRearrange.constructLROutput(java.util.List<Result> resLst,
Tuple value) |
protected Tuple |
POCollectedGroup.constructOutput(java.util.List<Result> resLst,
Tuple value) |
protected DataBag |
POPartitionRearrange.constructPROutput(java.util.List<Result> resLst,
Tuple value) |
protected Result |
POPoissonSample.createNumRowTuple(Tuple sample) |
protected Tuple |
POForEach.createTuple(java.lang.Object[] data) |
java.lang.Object |
Packager.getKey(PigNullableWritable key) |
protected java.lang.Object |
POLocalRearrange.getKeyFromResult(java.util.List<Result> resLst,
byte type) |
Result |
Packager.getNext() |
Result |
MultiQueryPackager.getNext()
Constructs the output tuple from the inputs.
|
Result |
LitePackager.getNext()
Similar to POPackage.getNext except that
only one input is expected with index 0
and ReadOnceBag is used instead of
DefaultDataBag.
|
Result |
JoinPackager.getNext()
Calls getNext to get next ForEach result.
|
Result |
CombinerPackager.getNext() |
Result |
POStream.getNextHelper(Tuple t) |
Result |
POUnion.getNextTuple()
The code below, tries to follow our single threaded
shared execution model with execution being passed
around each non-drained input
|
Result |
POStream.getNextTuple() |
Result |
POStore.getNextTuple() |
Result |
POSplit.getNextTuple() |
Result |
POSortedDistinct.getNextTuple() |
Result |
POSort.getNextTuple() |
Result |
POReservoirSample.getNextTuple() |
Result |
PORank.getNextTuple() |
Result |
POPreCombinerLocalRearrange.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan.
|
Result |
POPoissonSample.getNextTuple() |
Result |
POPartitionRearrange.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan.
|
Result |
POPartialAgg.getNextTuple() |
Result |
POPackage.getNextTuple()
From the inputs, constructs the output tuple for this co-group in the
required format which is (key, {bag of tuples from input 1}, {bag of
tuples from input 2}, ...)
|
Result |
POOptimizedForEach.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan and returns it maintaining an additional state
to denote the begin and end of the nested plan processing.
|
Result |
POMergeJoin.getNextTuple() |
Result |
POMergeCogroup.getNextTuple() |
Result |
POLocalRearrange.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan.
|
Result |
POLoad.getNextTuple()
The main method used by this operator's successor
to read tuples from the specified file using the
specified load function.
|
Result |
POLimit.getNextTuple()
Counts the number of tuples processed into static variable soFar, if the number of tuples processed reach the
limit, return EOP; Otherwise, return the tuple
|
Result |
POForEach.getNextTuple()
Calls getNext on the generate operator inside the nested
physical plan and returns it maintaining an additional state
to denote the begin and end of the nested plan processing.
|
Result |
POFilter.getNextTuple()
Attaches the proccesed input tuple to the expression plan and checks if
comparison operator returns a true.
|
Result |
POFRJoin.getNextTuple() |
Result |
PODistinct.getNextTuple() |
Result |
PODemux.getNextTuple() |
Result |
POCross.getNextTuple() |
Result |
POCounter.getNextTuple() |
Result |
POCollectedGroup.getNextTuple() |
Tuple |
Packager.getValueTuple(PigNullableWritable keyWritable,
NullableTuple ntup,
int index) |
Tuple |
MultiQueryPackager.getValueTuple(PigNullableWritable keyWritable,
NullableTuple ntup,
int origIndex) |
Tuple |
LitePackager.getValueTuple(PigNullableWritable keyWritable,
NullableTuple ntup,
int index)
Makes use of the superclass method, but this requires an additional
parameter key passed by ReadOnceBag.
|
Tuple |
CombinerPackager.getValueTuple(PigNullableWritable keyWritable,
NullableTuple ntup,
int index) |
protected Tuple |
POFRJoin.getValueTuple(POLocalRearrange lr,
Tuple tuple) |
protected boolean |
POFRJoin.isKeyNull(java.lang.Object key) |
boolean |
POForEach.needEndOfAllInputProcessing() |
protected Result |
POForEach.processPlan() |
void |
POLocalRearrange.setIndex(int index)
Sets the co-group index of this operator
|
void |
POLocalRearrange.setMultiQueryIndex(int index)
Sets the multi-query index of this operator
|
protected void |
POFRJoinSpark.setUpHashMap() |
protected void |
POFRJoin.setUpHashMap()
Builds the HashMaps by reading each replicated input from the DFS using a
Load operator
|
void |
POMergeJoin.throwProcessingException(boolean withCauseException,
java.lang.Exception e) |
Constructor and Description |
---|
POBroadcastSpark(POBroadcastSpark copy) |
POFRJoin(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
java.util.List<java.util.List<PhysicalPlan>> ppLists,
java.util.List<java.util.List<java.lang.Byte>> keyTypes,
FileSpec[] replFiles,
int fragment,
boolean isLeftOuter,
Tuple nullTuple) |
POFRJoin(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
java.util.List<java.util.List<PhysicalPlan>> ppLists,
java.util.List<java.util.List<java.lang.Byte>> keyTypes,
FileSpec[] replFiles,
int fragment,
boolean isLeftOuter,
Tuple nullTuple,
Schema[] inputSchemas,
Schema[] keySchemas) |
POFRJoin(POFRJoin copy) |
POFRJoinSpark(POFRJoin copy) |
POGlobalRearrange(POGlobalRearrange copy) |
Modifier and Type | Method and Description |
---|---|
static void |
SparkUtil.createIndexerSparkNode(SparkOperator baseSparkOp,
java.lang.String scope,
NodeIdGenerator nig) |
Modifier and Type | Method and Description |
---|---|
Result |
POPoissonSampleSpark.getNextTuple() |
Constructor and Description |
---|
POGlobalRearrangeSpark(POGlobalRearrange copy) |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapred.JobConf |
TezExecutionEngine.getExecConf(java.util.Properties properties) |
Modifier and Type | Method and Description |
---|---|
void |
BloomPackager.attachInput(java.lang.Object key,
DataBag[] bags,
boolean[] readOnce) |
void |
POValueInputTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POSimpleTezLoad.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POShuffledValueInputTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POShuffleTezLoad.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
PORankTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POIdentityInOutTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POFRJoinTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POCounterStatsTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POBloomFilterRearrangeTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POValueOutputTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POStoreTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POLocalRearrangeTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POIdentityInOutTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POCounterTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POCounterStatsTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
POBuildBloomRearrangeTez.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
protected DataBag |
POPartitionRearrangeTez.constructPROutput(java.util.List<Result> resLst,
Tuple value) |
Result |
BloomPackager.getNext() |
Result |
POValueOutputTez.getNextTuple() |
Result |
POValueInputTez.getNextTuple() |
Result |
POStoreTez.getNextTuple() |
Result |
POSimpleTezLoad.getNextTuple()
Previously, we reused the same Result object for all results, but we found
certain operators (e.g.
|
Result |
POShuffledValueInputTez.getNextTuple() |
Result |
POShuffleTezLoad.getNextTuple() |
Result |
PORankTez.getNextTuple() |
Result |
POPartitionRearrangeTez.getNextTuple()
Calls getNext on the generate operator inside the nested physical plan.
|
Result |
POLocalRearrangeTez.getNextTuple() |
Result |
POIdentityInOutTez.getNextTuple() |
Result |
POCounterTez.getNextTuple() |
Result |
POCounterStatsTez.getNextTuple() |
Result |
POBuildBloomRearrangeTez.getNextTuple() |
Result |
POBloomFilterRearrangeTez.getNextTuple() |
protected Result |
POLocalRearrangeTez.getRearrangedTuple() |
void |
POValueOutputTez.initialize(org.apache.tez.runtime.api.ProcessorContext processorContext) |
void |
POStoreTez.initialize(org.apache.tez.runtime.api.ProcessorContext processorContext) |
void |
POSimpleTezLoad.initialize(org.apache.tez.runtime.api.ProcessorContext processorContext) |
void |
POCounterTez.initialize(org.apache.tez.runtime.api.ProcessorContext processorContext) |
protected void |
POFRJoinTez.setUpHashMap()
Builds the HashMaps by reading replicated inputs from broadcast edges
|
Constructor and Description |
---|
POFRJoinTez(POFRJoin copy,
java.util.List<java.lang.String> inputKeys) |
Modifier and Type | Method and Description |
---|---|
void |
ReadScalarsTez.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
void |
TezInput.attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
org.apache.hadoop.conf.Configuration conf)
Attach the inputs to the operator.
|
void |
TezOutput.attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
org.apache.hadoop.conf.Configuration conf) |
void |
TezTaskConfigurable.initialize(org.apache.tez.runtime.api.ProcessorContext processorContext) |
Modifier and Type | Method and Description |
---|---|
static boolean |
TezCompilerUtil.bagDataTypeInCombinePlan(PhysicalPlan combinePlan) |
Modifier and Type | Method and Description |
---|---|
static FileSpec |
MapRedUtil.checkLeafIsStore(PhysicalPlan plan,
PigContext pigContext) |
Modifier and Type | Method and Description |
---|---|
void |
HadoopExecutableManager.configure(POStream stream) |
Modifier and Type | Method and Description |
---|---|
protected static Tuple |
LongAvg.combine(DataBag values) |
protected static Tuple |
IntAvg.combine(DataBag values) |
protected static Tuple |
FloatAvg.combine(DataBag values) |
protected static Tuple |
DoubleAvg.combine(DataBag values) |
protected static Tuple |
BigIntegerAvg.combine(DataBag values) |
protected static Tuple |
BigDecimalAvg.combine(DataBag values) |
protected static Tuple |
AVG.combine(DataBag values) |
static void |
CubeDimensions.convertNullToUnknown(Tuple tuple) |
protected static long |
LongAvg.count(Tuple input) |
protected static long |
IntAvg.count(Tuple input) |
protected static long |
FloatAvg.count(Tuple input) |
protected static long |
DoubleAvg.count(Tuple input) |
protected static java.math.BigInteger |
BigIntegerAvg.count(Tuple input) |
protected static java.math.BigDecimal |
BigDecimalAvg.count(Tuple input) |
protected static long |
AVG.count(Tuple input) |
protected static java.lang.Long |
AlgebraicLongMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider) |
protected static java.lang.Integer |
AlgebraicIntMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider) |
protected static java.lang.Float |
AlgebraicFloatMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider) |
protected static java.lang.Double |
AlgebraicDoubleMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider) |
protected static java.math.BigInteger |
AlgebraicBigIntegerMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider) |
protected static java.math.BigDecimal |
AlgebraicBigDecimalMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider) |
protected static java.lang.Double |
AlgebraicByteArrayMathBase.doTupleWork(Tuple input,
AlgebraicMathBase.KnownOpProvider opProvider,
byte expectedType) |
protected static java.lang.String |
StringMax.max(Tuple input) |
protected static org.joda.time.DateTime |
DateTimeMax.max(Tuple input) |
protected static java.lang.String |
StringMin.min(Tuple input) |
protected static org.joda.time.DateTime |
DateTimeMin.min(Tuple input) |
protected static java.lang.Long |
LongAvg.sum(Tuple input) |
protected static java.lang.Long |
IntAvg.sum(Tuple input) |
protected static java.lang.Double |
FloatAvg.sum(Tuple input) |
protected static java.lang.Double |
DoubleAvg.sum(Tuple input) |
protected static java.lang.Long |
COUNT_STAR.sum(Tuple input) |
protected static java.lang.Long |
COUNT.sum(Tuple input) |
protected static java.math.BigInteger |
BigIntegerAvg.sum(Tuple input) |
protected static java.math.BigDecimal |
BigDecimalAvg.sum(Tuple input) |
protected static java.lang.Double |
AVG.sum(Tuple input) |
Modifier and Type | Class and Description |
---|---|
class |
FieldIsNullException |
Modifier and Type | Method and Description |
---|---|
static Schema.FieldSchema |
DataType.determineFieldSchema(java.lang.Object o)
Determine the field schema of an object
|
static Schema.FieldSchema |
DataType.determineFieldSchema(ResourceSchema.ResourceFieldSchema rcFieldSchema)
Determine the field schema of an ResourceFieldSchema
|
protected abstract java.math.BigDecimal |
SchemaTuple.generatedCodeGetBigDecimal(int fieldNum) |
protected abstract java.math.BigInteger |
SchemaTuple.generatedCodeGetBigInteger(int fieldNum) |
protected abstract boolean |
SchemaTuple.generatedCodeGetBoolean(int fieldNum) |
protected abstract byte[] |
SchemaTuple.generatedCodeGetBytes(int fieldNum) |
protected abstract DataBag |
SchemaTuple.generatedCodeGetDataBag(int fieldNum) |
protected abstract org.joda.time.DateTime |
SchemaTuple.generatedCodeGetDateTime(int fieldNum) |
protected abstract double |
SchemaTuple.generatedCodeGetDouble(int fieldNum) |
abstract java.lang.Object |
SchemaTuple.generatedCodeGetField(int fieldNum) |
protected abstract float |
SchemaTuple.generatedCodeGetFloat(int fieldNum) |
protected abstract int |
SchemaTuple.generatedCodeGetInt(int fieldNum) |
protected abstract long |
SchemaTuple.generatedCodeGetLong(int fieldNum) |
protected abstract java.util.Map<java.lang.String,java.lang.Object> |
SchemaTuple.generatedCodeGetMap(int fieldNum) |
protected abstract java.lang.String |
SchemaTuple.generatedCodeGetString(int fieldNum) |
protected abstract Tuple |
SchemaTuple.generatedCodeGetTuple(int fieldNum) |
protected abstract SchemaTuple<T> |
SchemaTuple.generatedCodeSet(SchemaTuple<?> t,
boolean checkType) |
protected abstract void |
SchemaTuple.generatedCodeSetBigDecimal(int fieldNum,
java.math.BigDecimal val) |
protected abstract void |
SchemaTuple.generatedCodeSetBigInteger(int fieldNum,
java.math.BigInteger val) |
protected abstract void |
SchemaTuple.generatedCodeSetBoolean(int fieldNum,
boolean val) |
protected abstract void |
SchemaTuple.generatedCodeSetBytes(int fieldNum,
byte[] val) |
protected abstract void |
SchemaTuple.generatedCodeSetDataBag(int fieldNum,
DataBag val) |
protected abstract void |
SchemaTuple.generatedCodeSetDateTime(int fieldNum,
org.joda.time.DateTime val) |
protected abstract void |
SchemaTuple.generatedCodeSetDouble(int fieldNum,
double val) |
abstract void |
SchemaTuple.generatedCodeSetField(int fieldNum,
java.lang.Object val) |
protected abstract void |
SchemaTuple.generatedCodeSetFloat(int fieldNum,
float val) |
protected abstract void |
SchemaTuple.generatedCodeSetInt(int fieldNum,
int val) |
protected abstract void |
SchemaTuple.generatedCodeSetIterator(java.util.Iterator<java.lang.Object> l) |
protected abstract void |
SchemaTuple.generatedCodeSetLong(int fieldNum,
long val) |
protected abstract void |
SchemaTuple.generatedCodeSetMap(int fieldNum,
java.util.Map<java.lang.String,java.lang.Object> val) |
protected abstract void |
SchemaTuple.generatedCodeSetString(int fieldNum,
java.lang.String val) |
protected abstract void |
SchemaTuple.generatedCodeSetTuple(int fieldNum,
Tuple val) |
java.lang.Object |
UnlimitedNullTuple.get(int fieldNum) |
java.lang.Object |
Tuple.get(int fieldNum)
Get the value in a given field.
|
java.lang.Object |
TargetedTuple.get(int fieldNum) |
java.lang.Object |
SchemaTuple.get(int fieldNum) |
java.lang.Object |
NonWritableTuple.get(int fieldNum) |
java.lang.Object |
DefaultTuple.get(int fieldNum)
Get the value in a given field.
|
java.lang.Object |
AppendableSchemaTuple.get(int fieldNum) |
protected java.lang.Object |
AppendableSchemaTuple.getAppendedField(int i) |
java.math.BigDecimal |
TypeAwareTuple.getBigDecimal(int idx) |
java.math.BigDecimal |
SchemaTuple.getBigDecimal(int fieldNum) |
java.math.BigInteger |
TypeAwareTuple.getBigInteger(int idx) |
java.math.BigInteger |
SchemaTuple.getBigInteger(int fieldNum) |
boolean |
TypeAwareTuple.getBoolean(int idx) |
boolean |
SchemaTuple.getBoolean(int fieldNum) |
byte[] |
TypeAwareTuple.getBytes(int idx) |
byte[] |
SchemaTuple.getBytes(int fieldNum) |
DataBag |
TypeAwareTuple.getDataBag(int idx) |
DataBag |
SchemaTuple.getDataBag(int fieldNum) |
org.joda.time.DateTime |
TypeAwareTuple.getDateTime(int idx) |
org.joda.time.DateTime |
SchemaTuple.getDateTime(int fieldNum) |
double |
TypeAwareTuple.getDouble(int idx) |
double |
SchemaTuple.getDouble(int fieldNum) |
float |
TypeAwareTuple.getFloat(int idx) |
float |
SchemaTuple.getFloat(int fieldNum) |
abstract byte |
SchemaTuple.getGeneratedCodeFieldType(int fieldNum) |
int |
TypeAwareTuple.getInt(int idx) |
int |
SchemaTuple.getInt(int fieldNum) |
long |
TypeAwareTuple.getLong(int idx) |
long |
SchemaTuple.getLong(int fieldNum) |
java.util.Map<java.lang.String,java.lang.Object> |
TypeAwareTuple.getMap(int idx) |
java.util.Map<java.lang.String,java.lang.Object> |
SchemaTuple.getMap(int fieldNum) |
java.lang.String |
TypeAwareTuple.getString(int idx) |
java.lang.String |
SchemaTuple.getString(int fieldNum) |
Tuple |
TypeAwareTuple.getTuple(int idx) |
Tuple |
SchemaTuple.getTuple(int fieldNum) |
byte |
Tuple.getType(int fieldNum)
Find the type of a given field.
|
byte |
TargetedTuple.getType(int fieldNum) |
byte |
SchemaTuple.getType(int fieldNum) |
byte |
AppendableSchemaTuple.getType(int fieldNum) |
byte |
AbstractTuple.getType(int fieldNum)
Find the type of a given field.
|
protected java.lang.Object |
SchemaTuple.getTypeAwareBase(int fieldNum,
java.lang.String type) |
protected java.lang.Object |
AppendableSchemaTuple.getTypeAwareBase(int fieldNum,
java.lang.String type) |
abstract boolean |
SchemaTuple.isGeneratedCodeFieldNull(int fieldNum) |
boolean |
Tuple.isNull(int fieldNum)
Find out if a given field is null.
|
boolean |
SchemaTuple.isNull(int fieldNum) |
boolean |
AppendableSchemaTuple.isNull(int fieldNum) |
boolean |
AbstractTuple.isNull(int fieldNum)
Find out if a given field is null.
|
java.lang.Object |
InterSedes.readDatum(java.io.DataInput in)
Get the next object from DataInput in
|
static java.lang.Object |
DataReaderWriter.readDatum(java.io.DataInput in) |
java.lang.Object |
BinInterSedes.readDatum(java.io.DataInput in) |
java.lang.Object |
InterSedes.readDatum(java.io.DataInput in,
byte type)
Get the next object from DataInput in of the type of type argument
The type information has been read from DataInput.
|
static java.lang.Object |
DataReaderWriter.readDatum(java.io.DataInput in,
byte type) |
java.lang.Object |
BinInterSedes.readDatum(java.io.DataInput in,
byte type)
Expects binInterSedes data types (NOT DataType types!)
|
void |
UnlimitedNullTuple.set(int fieldNum,
java.lang.Object val) |
void |
Tuple.set(int fieldNum,
java.lang.Object val)
Set the value in a given field.
|
void |
TargetedTuple.set(int fieldNum,
java.lang.Object val) |
void |
SchemaTuple.set(int fieldNum,
java.lang.Object val) |
void |
NonWritableTuple.set(int fieldNum,
java.lang.Object val) |
void |
DefaultTuple.set(int fieldNum,
java.lang.Object val)
Set the value in a given field.
|
void |
AppendableSchemaTuple.set(int fieldNum,
java.lang.Object val) |
SchemaTuple<T> |
SchemaTuple.set(java.util.List<java.lang.Object> l) |
SchemaTuple<T> |
AppendableSchemaTuple.set(java.util.List<java.lang.Object> l) |
SchemaTuple<T> |
SchemaTuple.set(SchemaTuple<?> t) |
protected SchemaTuple<T> |
SchemaTuple.set(SchemaTuple<?> t,
boolean checkType) |
protected SchemaTuple<T> |
AppendableSchemaTuple.set(SchemaTuple<?> t,
boolean checkType) |
SchemaTuple<T> |
SchemaTuple.set(Tuple t) |
protected SchemaTuple<T> |
SchemaTuple.set(Tuple t,
boolean checkType) |
void |
TypeAwareTuple.setBigDecimal(int idx,
java.math.BigDecimal val) |
void |
SchemaTuple.setBigDecimal(int fieldNum,
java.math.BigDecimal val) |
void |
TypeAwareTuple.setBigInteger(int idx,
java.math.BigInteger val) |
void |
SchemaTuple.setBigInteger(int fieldNum,
java.math.BigInteger val) |
void |
TypeAwareTuple.setBoolean(int idx,
boolean val) |
void |
SchemaTuple.setBoolean(int fieldNum,
boolean val) |
void |
TypeAwareTuple.setBytes(int idx,
byte[] val) |
void |
SchemaTuple.setBytes(int fieldNum,
byte[] val) |
void |
TypeAwareTuple.setDataBag(int idx,
DataBag val) |
void |
SchemaTuple.setDataBag(int fieldNum,
DataBag val) |
void |
TypeAwareTuple.setDateTime(int idx,
org.joda.time.DateTime val) |
void |
SchemaTuple.setDateTime(int fieldNum,
org.joda.time.DateTime val) |
void |
TypeAwareTuple.setDouble(int idx,
double val) |
void |
SchemaTuple.setDouble(int fieldNum,
double val) |
void |
TypeAwareTuple.setFloat(int idx,
float val) |
void |
SchemaTuple.setFloat(int fieldNum,
float val) |
void |
TypeAwareTuple.setInt(int idx,
int val) |
void |
SchemaTuple.setInt(int fieldNum,
int val) |
void |
TypeAwareTuple.setLong(int idx,
long val) |
void |
SchemaTuple.setLong(int fieldNum,
long val) |
void |
TypeAwareTuple.setMap(int idx,
java.util.Map<java.lang.String,java.lang.Object> val) |
void |
SchemaTuple.setMap(int fieldNum,
java.util.Map<java.lang.String,java.lang.Object> val) |
void |
TypeAwareTuple.setString(int idx,
java.lang.String val) |
void |
SchemaTuple.setString(int fieldNum,
java.lang.String val) |
void |
TypeAwareTuple.setTuple(int idx,
Tuple val) |
void |
SchemaTuple.setTuple(int fieldNum,
Tuple val) |
protected void |
SchemaTuple.setTypeAwareBase(int fieldNum,
java.lang.Object val,
java.lang.String type) |
protected void |
AppendableSchemaTuple.setTypeAwareBase(int fieldNum,
java.lang.Object val,
java.lang.String type) |
static DataBag |
DataType.toBag(java.lang.Object o)
If this object is a bag, return it as a bag.
|
static java.math.BigDecimal |
DataType.toBigDecimal(java.lang.Object o) |
static java.math.BigDecimal |
DataType.toBigDecimal(java.lang.Object o,
byte type) |
static java.math.BigInteger |
DataType.toBigInteger(java.lang.Object o) |
static java.math.BigInteger |
DataType.toBigInteger(java.lang.Object o,
byte type) |
static java.lang.Boolean |
DataType.toBoolean(java.lang.Object o) |
static java.lang.Boolean |
DataType.toBoolean(java.lang.Object o,
byte type)
Force a data object to a Boolean, if possible.
|
static byte[] |
DataType.toBytes(java.lang.Object o) |
static byte[] |
DataType.toBytes(java.lang.Object o,
byte type) |
static org.joda.time.DateTime |
DataType.toDateTime(java.lang.Object o) |
static org.joda.time.DateTime |
DataType.toDateTime(java.lang.Object o,
byte type)
Force a data object to a DateTime, if possible.
|
java.lang.String |
Tuple.toDelimitedString(java.lang.String delim)
Write a tuple of values into a string.
|
java.lang.String |
AbstractTuple.toDelimitedString(java.lang.String delim)
Write a tuple of values into a string.
|
static java.lang.Double |
DataType.toDouble(java.lang.Object o)
Force a data object to a Double, if possible.
|
static java.lang.Double |
DataType.toDouble(java.lang.Object o,
byte type)
Force a data object to a Double, if possible.
|
static java.lang.Float |
DataType.toFloat(java.lang.Object o)
Force a data object to a Float, if possible.
|
static java.lang.Float |
DataType.toFloat(java.lang.Object o,
byte type)
Force a data object to a Float, if possible.
|
static java.lang.Integer |
DataType.toInteger(java.lang.Object o)
Force a data object to an Integer, if possible.
|
static java.lang.Integer |
DataType.toInteger(java.lang.Object o,
byte type)
Force a data object to an Integer, if possible.
|
static java.lang.Long |
DataType.toLong(java.lang.Object o)
Force a data object to a Long, if possible.
|
static java.lang.Long |
DataType.toLong(java.lang.Object o,
byte type)
Force a data object to a Long, if possible.
|
static java.util.Map<java.lang.String,java.lang.Object> |
DataType.toMap(java.lang.Object o)
If this object is a map, return it as a map.
|
static java.lang.String |
DataType.toString(java.lang.Object o)
Force a data object to a String, if possible.
|
static java.lang.String |
DataType.toString(java.lang.Object o,
byte type)
Force a data object to a String, if possible.
|
static Tuple |
DataType.toTuple(java.lang.Object o)
If this object is a tuple, return it as a tuple.
|
Modifier and Type | Method and Description |
---|---|
void |
PigContext.connect() |
ExecutableManager |
PigContext.createExecutableManager()
Create a new
ExecutableManager depending on the ExecType. |
static <T> T |
PigContext.instantiateObjectFromParams(org.apache.hadoop.conf.Configuration conf,
java.lang.String classParamKey,
java.lang.String argParamKey,
java.lang.Class<T> clazz)
A common Pig pattern for initializing objects via system properties is to support passing
something like this on the command line:
-Dpig.notification.listener=MyClass
-Dpig.notification.listener.arg=myConstructorStringArg
This method will properly initialize the class with the args, if they exist. |
Modifier and Type | Method and Description |
---|---|
void |
SampleLoader.computeSamples(java.util.ArrayList<Pair<FileSpec,java.lang.Boolean>> inputs,
PigContext pc) |
java.lang.Object |
IdentityColumn.exec(Tuple input) |
Constructor and Description |
---|
StreamingUDF(java.lang.String language,
java.lang.String filePath,
java.lang.String funcName,
java.lang.String outputSchemaString,
java.lang.String schemaLineNumber,
java.lang.String execType,
java.lang.String isIllustrate) |
Modifier and Type | Class and Description |
---|---|
class |
StreamingUDFException |
Modifier and Type | Method and Description |
---|---|
void |
ExecutableManager.configure(POStream stream)
Configure and initialize the
ExecutableManager . |
static InputHandler |
HandlerFactory.createInputHandler(StreamingCommand command)
Create an
InputHandler for the given input specification
of the StreamingCommand . |
static OutputHandler |
HandlerFactory.createOutputHandler(StreamingCommand command)
Create an
OutputHandler for the given output specification
of the StreamingCommand . |
Constructor and Description |
---|
FileInputHandler(StreamingCommand.HandleSpec handleSpec) |
FileOutputHandler(StreamingCommand.HandleSpec handleSpec) |
Modifier and Type | Method and Description |
---|---|
java.lang.Object |
AvroTupleWrapper.get(int pos) |
static byte |
AvroStorageSchemaConversionUtilities.getPigType(org.apache.avro.Schema s)
Determines the pig object type of the Avro schema.
|
byte |
AvroTupleWrapper.getType(int arg0) |
boolean |
AvroTupleWrapper.isNull(int arg0) |
void |
AvroTupleWrapper.set(int arg0,
java.lang.Object arg1) |
java.lang.String |
AvroTupleWrapper.toDelimitedString(java.lang.String arg0) |
Modifier and Type | Method and Description |
---|---|
java.util.Map<LOLoad,DataBag> |
AugmentBaseDataVisitor.getNewBaseData() |
Modifier and Type | Method and Description |
---|---|
java.lang.Object |
ExampleTuple.get(int fieldNum) |
byte |
ExampleTuple.getType(int fieldNum) |
boolean |
ExampleTuple.isNull(int fieldNum) |
void |
ExampleTuple.set(int fieldNum,
java.lang.Object val) |
Modifier and Type | Method and Description |
---|---|
protected static Tuple |
ExtremalTupleByNthField.extreme(int pind,
int psign,
Tuple input,
PigProgressable reporter) |
protected static Tuple |
MaxTupleBy1stField.max(DataBag values,
PigProgressable reporter) |
protected static Tuple |
MaxTupleBy1stField.max(Tuple input,
PigProgressable reporter) |
protected static int |
ExtremalTupleByNthField.parseFieldIndex(java.lang.String inputFieldIndex) |
Constructor and Description |
---|
ExtremalTupleByNthField()
Constructors
|
ExtremalTupleByNthField(java.lang.String fieldIndexString) |
ExtremalTupleByNthField(java.lang.String fieldIndexString,
java.lang.String order) |
HelperClass() |
HelperClass(java.lang.String fieldIndexString) |
HelperClass(java.lang.String fieldIndexString,
java.lang.String order) |
Modifier and Type | Method and Description |
---|---|
static org.joda.time.DateTime |
ISOHelper.parseDateTime(Tuple input) |
Modifier and Type | Method and Description |
---|---|
java.util.Map<java.lang.String,java.util.List<PigStats>> |
ScriptEngine.run(PigContext pigContext,
java.lang.String scriptFile)
Runs a script file.
|
Modifier and Type | Method and Description |
---|---|
static java.lang.Object |
GroovyUtils.groovyToPig(java.lang.Object groovyObject)
Converts an object created on the Groovy side to its Pig counterpart.
|
static java.lang.Object |
GroovyUtils.pigToGroovy(java.lang.Object pigObject)
Converts an object created on the Pig side to its Groovy counterpart.
|
Modifier and Type | Method and Description |
---|---|
void |
RubyDataBag.add(org.jruby.runtime.ThreadContext context,
org.jruby.runtime.builtin.IRubyObject[] args)
The add method accepts a varargs argument; each argument can be either a random
object, a DataBag, or a RubyArray.
|
org.jruby.runtime.builtin.IRubyObject |
RubyDataBag.each(org.jruby.runtime.ThreadContext context,
org.jruby.runtime.Block block)
This is an implementation of the each method which opens up the Enumerable interface,
and makes it very convenient to iterate over the elements of a DataBag.
|
org.jruby.runtime.builtin.IRubyObject |
RubyDataBag.flatten(org.jruby.runtime.ThreadContext context,
org.jruby.runtime.Block block)
This is a convenience method which will run the given block on the first element
of each tuple contained.
|
static <T> org.jruby.RubyHash |
PigJrubyLibrary.pigToRuby(org.jruby.Ruby ruby,
java.util.Map<T,?> object)
A type specific conversion routine for Pig Maps.
|
static org.jruby.runtime.builtin.IRubyObject |
PigJrubyLibrary.pigToRuby(org.jruby.Ruby ruby,
java.lang.Object object)
This is the method which provides conversion from Pig to Ruby.
|
static org.jruby.RubyArray |
PigJrubyLibrary.pigToRuby(org.jruby.Ruby ruby,
Tuple object)
A type specific conversion routine.
|
static java.lang.Object |
PigJrubyLibrary.rubyToPig(org.jruby.runtime.builtin.IRubyObject rbObject)
This method facilitates conversion from Ruby objects to Pig objects.
|
static Tuple |
PigJrubyLibrary.rubyToPig(org.jruby.RubyArray rbObject)
A type specific conversion routine.
|
static java.util.Map<java.lang.String,?> |
PigJrubyLibrary.rubyToPig(org.jruby.RubyHash rbObject)
A type specific conversion routine.
|
Modifier and Type | Method and Description |
---|---|
static java.lang.Object |
JythonUtils.pythonToPig(org.python.core.PyObject pyObject) |
Modifier and Type | Method and Description |
---|---|
java.util.List<ExecJob> |
ToolsPigServer.runPlan(LogicalPlan newPlan,
java.lang.String jobName)
Given a (modified) new logical plan, run the script.
|
Constructor and Description |
---|
ToolsPigServer(ExecType execType,
java.util.Properties properties) |
ToolsPigServer(PigContext ctx) |
ToolsPigServer(java.lang.String execTypeString) |
Constructor and Description |
---|
Grunt(java.io.BufferedReader in,
PigContext pigContext) |
Copyright © 2007-2017 The Apache Software Foundation