Package | Description |
---|---|
org.apache.pig |
Public interfaces and classes for Pig.
|
org.apache.pig.backend.hadoop.executionengine | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans | |
org.apache.pig.impl.logicalLayer |
The logical operators that represent a pig script and tools for manipulating
those operators.
|
org.apache.pig.impl.logicalLayer.validators | |
org.apache.pig.impl.plan | |
org.apache.pig.newplan | |
org.apache.pig.newplan.logical | |
org.apache.pig.newplan.logical.expression | |
org.apache.pig.newplan.logical.relational | |
org.apache.pig.parser | |
org.apache.pig.pen | |
org.apache.pig.pen.util | |
org.apache.pig.tools.pigstats | |
org.apache.pig.tools.pigstats.mapreduce | |
org.apache.pig.tools.pigstats.spark | |
org.apache.pig.tools.pigstats.tez |
Modifier and Type | Method and Description |
---|---|
java.util.Map<Operator,DataBag> |
PigServer.getExamples(java.lang.String alias) |
Modifier and Type | Field and Description |
---|---|
protected java.util.Map<Operator,PhysicalOperator> |
HExecutionEngine.newLogToPhyMap |
Modifier and Type | Method and Description |
---|---|
java.util.Map<Operator,PhysicalOperator> |
HExecutionEngine.getLogToPhyMap() |
Modifier and Type | Class and Description |
---|---|
class |
PatternNode
Used for finding/representing a pattern in the plan
This class represents a node in the pattern
|
Modifier and Type | Method and Description |
---|---|
boolean |
PatternNode.isEqual(Operator operator) |
Constructor and Description |
---|
FrontendException(Operator op,
java.lang.String message)
Create a new FrontendException with the specified message and cause.
|
FrontendException(Operator op,
java.lang.String message,
int errCode)
Create a new FrontendException with the specified message and cause.
|
FrontendException(Operator op,
java.lang.String message,
int errCode,
byte errSrc)
Create a new FrontendException with the specified message and cause.
|
FrontendException(Operator op,
java.lang.String message,
int errCode,
byte errSrc,
boolean retry,
java.lang.String detailedMsg,
java.lang.Throwable cause)
Create a new FrontendException with the specified message, error code, error source, retriable or not, detalied message for the developer and cause.
|
FrontendException(Operator op,
java.lang.String message,
int errCode,
byte errSrc,
java.lang.Throwable cause)
Create a new FrontendException with the specified message and cause.
|
FrontendException(Operator op,
java.lang.String message,
int errCode,
java.lang.Throwable cause)
Create a new FrontendException with the specified message and cause.
|
Constructor and Description |
---|
TypeCheckerException(Operator op,
java.lang.String message,
int errCode,
byte errSrc)
Create a new TypeCheckerException with the specified message and cause.
|
TypeCheckerException(Operator op,
java.lang.String message,
int errCode,
byte errSrc,
java.lang.Throwable cause)
Create a new TypeCheckerException with the specified message and cause.
|
Constructor and Description |
---|
PlanValidationException(Operator op,
java.lang.String message)
Create a new PlanValidationException with the specified message and cause.
|
PlanValidationException(Operator op,
java.lang.String message,
int errCode)
Create a new PlanValidationException with the specified message and cause.
|
PlanValidationException(Operator op,
java.lang.String message,
int errCode,
byte errSrc)
Create a new PlanValidationException with the specified message and cause.
|
VisitorException(Operator op,
java.lang.String message)
Create a new VisitorException with the specified message and cause.
|
VisitorException(Operator op,
java.lang.String message,
int errCode)
Create a new VisitorException with the specified message and cause.
|
VisitorException(Operator op,
java.lang.String message,
int errCode,
byte errSrc)
Create a new VisitorException with the specified message and cause.
|
VisitorException(Operator op,
java.lang.String message,
int errCode,
byte errSrc,
java.lang.Throwable cause)
Create a new VisitorException with the specified message and cause.
|
Modifier and Type | Field and Description |
---|---|
protected java.util.Set<Operator> |
DotPlanDumper.mMultiInputSubgraphs |
protected java.util.Set<Operator> |
DotPlanDumper.mMultiOutputSubgraphs |
protected java.util.Set<Operator> |
DotPlanDumper.mSubgraphs |
protected java.util.List<Operator> |
BaseOperatorPlan.ops |
Modifier and Type | Method and Description |
---|---|
protected MultiMap<Operator,BaseOperatorPlan> |
PlanDumper.getMultiInputNestedPlans(Operator op)
Used to determine if an operator has nested plans, which are
connected to specific input operators.
|
java.util.Iterator<Operator> |
OperatorSubPlan.getOperators() |
java.util.Iterator<Operator> |
OperatorPlan.getOperators()
Get an iterator of all operators in this plan
|
java.util.Iterator<Operator> |
BaseOperatorPlan.getOperators() |
java.util.List<Operator> |
OperatorSubPlan.getPredecessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getPredecessors(Operator op)
For a given operator, get all operators immediately before it in the
plan.
|
java.util.List<Operator> |
BaseOperatorPlan.getPredecessors(Operator op)
For a given operator, get all operators immediately before it in the
plan.
|
java.util.List<Operator> |
OperatorSubPlan.getSinks() |
java.util.List<Operator> |
OperatorPlan.getSinks()
Get all operators in the plan that have no successors.
|
java.util.List<Operator> |
BaseOperatorPlan.getSinks()
Get all operators in the plan that have no successors.
|
java.util.List<Operator> |
OperatorSubPlan.getSoftLinkPredecessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getSoftLinkPredecessors(Operator op)
For a given operator, get all operators softly immediately before it in the
plan.
|
java.util.List<Operator> |
BaseOperatorPlan.getSoftLinkPredecessors(Operator op)
For a given operator, get all operators softly immediately before it in the
plan.
|
java.util.List<Operator> |
OperatorSubPlan.getSoftLinkSuccessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getSoftLinkSuccessors(Operator op)
For a given operator, get all operators softly immediately after it.
|
java.util.List<Operator> |
BaseOperatorPlan.getSoftLinkSuccessors(Operator op)
For a given operator, get all operators softly immediately after it.
|
java.util.List<Operator> |
OperatorSubPlan.getSources() |
java.util.List<Operator> |
OperatorPlan.getSources()
Get all operators in the plan that have no predecessors.
|
java.util.List<Operator> |
BaseOperatorPlan.getSources()
Get all operators in the plan that have no predecessors.
|
java.util.List<Operator> |
OperatorSubPlan.getSuccessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getSuccessors(Operator op)
For a given operator, get all operators immediately after it.
|
java.util.List<Operator> |
BaseOperatorPlan.getSuccessors(Operator op)
For a given operator, get all operators immediately after it.
|
Pair<Operator,java.lang.Integer> |
PlanEdge.removeWithPosition(Operator key,
Operator value)
Remove one value from an existing key and return which position in
the arraylist the value was at..
|
Modifier and Type | Method and Description |
---|---|
void |
OperatorSubPlan.add(Operator op) |
void |
OperatorPlan.add(Operator op)
Add a new operator to the plan.
|
void |
BaseOperatorPlan.add(Operator op)
Add a new operator to the plan.
|
void |
OperatorSubPlan.connect(Operator from,
int fromPos,
Operator to,
int toPos) |
void |
OperatorPlan.connect(Operator from,
int fromPos,
Operator to,
int toPos)
Connect two operators in the plan, controlling which position in the
edge lists that the from and to edges are placed.
|
void |
BaseOperatorPlan.connect(Operator from,
int fromPos,
Operator to,
int toPos)
Connect two operators in the plan, controlling which position in the
edge lists that the from and to edges are placed.
|
void |
OperatorSubPlan.connect(Operator from,
Operator to) |
void |
OperatorPlan.connect(Operator from,
Operator to)
Connect two operators in the plan.
|
void |
BaseOperatorPlan.connect(Operator from,
Operator to)
Connect two operators in the plan.
|
void |
OperatorSubPlan.createSoftLink(Operator from,
Operator to) |
void |
OperatorPlan.createSoftLink(Operator from,
Operator to)
Create an soft edge between two nodes.
|
void |
BaseOperatorPlan.createSoftLink(Operator from,
Operator to)
Create an soft edge between two nodes.
|
Pair<java.lang.Integer,java.lang.Integer> |
OperatorSubPlan.disconnect(Operator from,
Operator to) |
Pair<java.lang.Integer,java.lang.Integer> |
OperatorPlan.disconnect(Operator from,
Operator to)
Disconnect two operators in the plan.
|
Pair<java.lang.Integer,java.lang.Integer> |
BaseOperatorPlan.disconnect(Operator from,
Operator to)
Disconnect two operators in the plan.
|
protected void |
DependencyOrderWalker.doAllPredecessors(Operator node,
java.util.Set<Operator> seen,
java.util.Collection<Operator> fifo) |
protected void |
ReverseDependencyOrderWalkerWOSeenChk.doAllSuccessors(Operator node,
java.util.Collection<Operator> fifo) |
protected void |
ReverseDependencyOrderWalker.doAllSuccessors(Operator node,
java.util.Set<Operator> seen,
java.util.Collection<Operator> fifo) |
protected void |
PlanDumper.dumpEdge(Operator op,
Operator suc)
Will be called to dump the edges of the plan.
|
protected void |
DotPlanDumper.dumpEdge(Operator op,
Operator suc) |
protected void |
DotPlanDumper.dumpInvisibleOperators(Operator op) |
protected void |
PlanDumper.dumpMultiInputNestedOperator(Operator op,
MultiMap<Operator,BaseOperatorPlan> plans)
Will be called when an operator has nested plans, which are
connected to one of the multiple inputs.
|
protected void |
DotPlanDumper.dumpMultiInputNestedOperator(Operator op,
MultiMap<Operator,BaseOperatorPlan> plans) |
protected void |
PlanDumper.dumpMultiOutputNestedOperator(Operator op,
java.util.Collection<BaseOperatorPlan> plans)
Will be called for nested operators, where the plans represent
how the output of the operator is processed.
|
protected void |
DotPlanDumper.dumpMultiOutputNestedOperator(Operator op,
java.util.Collection<BaseOperatorPlan> plans) |
protected void |
PlanDumper.dumpNestedOperator(Operator op,
java.util.Collection<BaseOperatorPlan> plans)
Will be called for nested operators.
|
protected void |
DotPlanDumper.dumpNestedOperator(Operator op,
java.util.Collection<BaseOperatorPlan> plans) |
protected void |
PlanDumper.dumpOperator(Operator op)
Will be called to dump a simple operator
|
protected void |
DotPlanDumper.dumpOperator(Operator op) |
protected java.lang.String[] |
DotPlanDumper.getAttributes(Operator op)
Used to generate the the attributes of a node
|
protected MultiMap<Operator,BaseOperatorPlan> |
PlanDumper.getMultiInputNestedPlans(Operator op)
Used to determine if an operator has nested plans, which are
connected to specific input operators.
|
protected java.util.Collection<BaseOperatorPlan> |
PlanDumper.getMultiOutputNestedPlans(Operator op)
Used to determine if an operator has nested output plans
|
protected java.lang.String |
DotPlanDumper.getName(Operator op)
Used to generate the label for an operator.
|
protected java.util.Collection<BaseOperatorPlan> |
PlanDumper.getNestedPlans(Operator op)
Used to determine if an operator has nested plans (without
connections to in- or output operators.
|
java.util.List<Operator> |
OperatorSubPlan.getPredecessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getPredecessors(Operator op)
For a given operator, get all operators immediately before it in the
plan.
|
java.util.List<Operator> |
BaseOperatorPlan.getPredecessors(Operator op)
For a given operator, get all operators immediately before it in the
plan.
|
java.util.List<Operator> |
OperatorSubPlan.getSoftLinkPredecessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getSoftLinkPredecessors(Operator op)
For a given operator, get all operators softly immediately before it in the
plan.
|
java.util.List<Operator> |
BaseOperatorPlan.getSoftLinkPredecessors(Operator op)
For a given operator, get all operators softly immediately before it in the
plan.
|
java.util.List<Operator> |
OperatorSubPlan.getSoftLinkSuccessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getSoftLinkSuccessors(Operator op)
For a given operator, get all operators softly immediately after it.
|
java.util.List<Operator> |
BaseOperatorPlan.getSoftLinkSuccessors(Operator op)
For a given operator, get all operators softly immediately after it.
|
java.util.List<Operator> |
OperatorSubPlan.getSuccessors(Operator op) |
java.util.List<Operator> |
OperatorPlan.getSuccessors(Operator op)
For a given operator, get all operators immediately after it.
|
java.util.List<Operator> |
BaseOperatorPlan.getSuccessors(Operator op)
For a given operator, get all operators immediately after it.
|
void |
OperatorSubPlan.insertBetween(Operator pred,
Operator operatorToInsert,
Operator succ) |
void |
OperatorPlan.insertBetween(Operator pred,
Operator operatorToInsert,
Operator succ)
This method insert node operatorToInsert between pred and succ.
|
void |
BaseOperatorPlan.insertBetween(Operator pred,
Operator operatorToInsert,
Operator succ) |
boolean |
BaseOperatorPlan.isConnected(Operator from,
Operator to)
Check if given two operators are directly connected.
|
abstract boolean |
Operator.isEqual(Operator operator)
This is like a shallow equals comparison.
|
void |
BaseOperatorPlan.moveTree(Operator root,
BaseOperatorPlan newPlan)
Move everything below a given operator to the new operator plan.
|
boolean |
OperatorSubPlan.pathExists(Operator from,
Operator to) |
boolean |
OperatorPlan.pathExists(Operator load,
Operator store)
check if there is a path in the plan graph between the load operator to the store operator.
|
boolean |
BaseOperatorPlan.pathExists(Operator from,
Operator to)
A method to check if there is a path from a given node to another node
|
void |
PlanEdge.put(Operator key,
Operator value,
int pos)
Add an element to the map.
|
void |
OperatorSubPlan.remove(Operator op) |
void |
OperatorPlan.remove(Operator op)
Remove an operator from the plan.
|
void |
BaseOperatorPlan.remove(Operator op)
Remove an operator from the plan.
|
void |
OperatorSubPlan.removeAndReconnect(Operator operatorToRemove) |
void |
OperatorPlan.removeAndReconnect(Operator operatorToRemove)
This method remove a node operatorToRemove.
|
void |
BaseOperatorPlan.removeAndReconnect(Operator operatorToRemove) |
void |
OperatorSubPlan.removeSoftLink(Operator from,
Operator to) |
void |
OperatorPlan.removeSoftLink(Operator from,
Operator to)
Remove an soft edge
|
void |
BaseOperatorPlan.removeSoftLink(Operator from,
Operator to)
Remove an soft edge
|
Pair<Operator,java.lang.Integer> |
PlanEdge.removeWithPosition(Operator key,
Operator value)
Remove one value from an existing key and return which position in
the arraylist the value was at..
|
void |
OperatorSubPlan.replace(Operator oldOperator,
Operator newOperator) |
void |
OperatorPlan.replace(Operator oldOperator,
Operator newOperator)
This method replace the oldOperator with the newOperator, make all connection
to the new operator in the place of old operator
|
void |
BaseOperatorPlan.replace(Operator oldOperator,
Operator newOperator) |
void |
BaseOperatorPlan.trimBelow(Operator op)
Trim everything below a given operator.
|
Modifier and Type | Method and Description |
---|---|
protected void |
DependencyOrderWalker.doAllPredecessors(Operator node,
java.util.Set<Operator> seen,
java.util.Collection<Operator> fifo) |
protected void |
DependencyOrderWalker.doAllPredecessors(Operator node,
java.util.Set<Operator> seen,
java.util.Collection<Operator> fifo) |
protected void |
ReverseDependencyOrderWalkerWOSeenChk.doAllSuccessors(Operator node,
java.util.Collection<Operator> fifo) |
protected void |
ReverseDependencyOrderWalker.doAllSuccessors(Operator node,
java.util.Set<Operator> seen,
java.util.Collection<Operator> fifo) |
protected void |
ReverseDependencyOrderWalker.doAllSuccessors(Operator node,
java.util.Set<Operator> seen,
java.util.Collection<Operator> fifo) |
protected void |
PlanDumper.dumpMultiInputNestedOperator(Operator op,
MultiMap<Operator,BaseOperatorPlan> plans)
Will be called when an operator has nested plans, which are
connected to one of the multiple inputs.
|
protected void |
DotPlanDumper.dumpMultiInputNestedOperator(Operator op,
MultiMap<Operator,BaseOperatorPlan> plans) |
Constructor and Description |
---|
SubtreeDependencyOrderWalker(OperatorPlan plan,
Operator startNode) |
Constructor and Description |
---|
DotPlanDumper(BaseOperatorPlan plan,
java.io.PrintStream ps,
boolean isSubGraph,
java.util.Set<Operator> mSubgraphs,
java.util.Set<Operator> mMultiInputSubgraphs,
java.util.Set<Operator> mMultiOutputSubgraphs) |
DotPlanDumper(BaseOperatorPlan plan,
java.io.PrintStream ps,
boolean isSubGraph,
java.util.Set<Operator> mSubgraphs,
java.util.Set<Operator> mMultiInputSubgraphs,
java.util.Set<Operator> mMultiOutputSubgraphs) |
DotPlanDumper(BaseOperatorPlan plan,
java.io.PrintStream ps,
boolean isSubGraph,
java.util.Set<Operator> mSubgraphs,
java.util.Set<Operator> mMultiInputSubgraphs,
java.util.Set<Operator> mMultiOutputSubgraphs) |
Modifier and Type | Method and Description |
---|---|
protected MultiMap<Operator,BaseOperatorPlan> |
DotLOPrinter.getMultiInputNestedPlans(Operator op) |
Modifier and Type | Method and Description |
---|---|
protected java.lang.String[] |
DotLOPrinter.getAttributes(Operator op) |
protected MultiMap<Operator,BaseOperatorPlan> |
DotLOPrinter.getMultiInputNestedPlans(Operator op) |
protected java.lang.String |
DotLOPrinter.getName(Operator op) |
protected java.util.Collection<BaseOperatorPlan> |
DotLOPrinter.getNestedPlans(Operator op) |
Modifier and Type | Class and Description |
---|---|
class |
AddExpression
Add Operator
|
class |
AndExpression
Boolean and expression.
|
class |
BinaryExpression
Superclass for all binary expressions
|
class |
BinCondExpression |
class |
CastExpression |
class |
ColumnExpression
Super class for all column expressions, including projection, constants, and deferences.
|
class |
ConstantExpression
A constant
|
class |
DereferenceExpression
get one or elements out of a tuple or a bag
in case of Tuple( a#2:int, b#3:bag{ b_a#4:int, b_b#5:float }, c#6:int ) # 1
(the number after # represents the uid)
Dereference ( 0 ) --> a:int
- dereference of single column in a tuple gives the field
Dereference ( 0,2 ) --> Tuple(a#2:int, c#6:int) #7
- dereference of more than one column gives a tuple
Dereference ( 1 ) --> Dereference ( 1 ) --> b:bag{b_b#5:float}#8
- dereference of a bag gives a bag
|
class |
DivideExpression
Divide Operator
|
class |
EqualExpression
Equality test expression.
|
class |
GreaterThanEqualExpression |
class |
GreaterThanExpression |
class |
IsNullExpression |
class |
LessThanEqualExpression |
class |
LessThanExpression |
class |
LogicalExpression
Logical representation of expression operators.
|
class |
MapLookupExpression |
class |
ModExpression
Mod Operator
|
class |
MultiplyExpression
Multiply Operator
|
class |
NegativeExpression |
class |
NotEqualExpression
NotEquality test expression.
|
class |
NotExpression |
class |
OrExpression
Boolean OR Expression
|
class |
ProjectExpression
Projection of columns in an expression.
|
class |
RegexExpression
Regex Operator
|
class |
ScalarExpression |
class |
SubtractExpression
Subtract Operator
|
class |
UnaryExpression
Superclass for all unary expressions
|
class |
UserFuncExpression |
Modifier and Type | Field and Description |
---|---|
protected java.util.Map<Operator,PhysicalOperator> |
ExpToPhyTranslationVisitor.logToPhyMap |
Modifier and Type | Method and Description |
---|---|
Operator |
ScalarExpression.getAttachedLogicalOperator() |
Operator |
ScalarExpression.getImplicitReferencedOperator() |
Operator |
ProjectExpression.getProjectedOperator() |
Modifier and Type | Method and Description |
---|---|
java.util.List<Operator> |
LogicalExpressionPlan.merge(LogicalExpressionPlan lgExpPlan)
Merge all nodes in lgExpPlan, keep the connections
|
Modifier and Type | Method and Description |
---|---|
boolean |
UserFuncExpression.isEqual(Operator other) |
boolean |
SubtractExpression.isEqual(Operator other) |
boolean |
RegexExpression.isEqual(Operator other) |
boolean |
ProjectExpression.isEqual(Operator other) |
boolean |
OrExpression.isEqual(Operator other) |
boolean |
NotExpression.isEqual(Operator other) |
boolean |
NotEqualExpression.isEqual(Operator other) |
boolean |
NegativeExpression.isEqual(Operator other) |
boolean |
MultiplyExpression.isEqual(Operator other) |
boolean |
ModExpression.isEqual(Operator other) |
boolean |
MapLookupExpression.isEqual(Operator other) |
boolean |
LessThanExpression.isEqual(Operator other) |
boolean |
LessThanEqualExpression.isEqual(Operator other) |
boolean |
IsNullExpression.isEqual(Operator other) |
boolean |
GreaterThanExpression.isEqual(Operator other) |
boolean |
GreaterThanEqualExpression.isEqual(Operator other) |
boolean |
EqualExpression.isEqual(Operator other) |
boolean |
DivideExpression.isEqual(Operator other) |
boolean |
DereferenceExpression.isEqual(Operator other) |
boolean |
ConstantExpression.isEqual(Operator other) |
boolean |
CastExpression.isEqual(Operator other) |
boolean |
BinCondExpression.isEqual(Operator other) |
boolean |
AndExpression.isEqual(Operator other) |
boolean |
AddExpression.isEqual(Operator other) |
void |
ScalarExpression.setAttachedLogicalOperator(Operator attachedLogicalOperator) |
void |
ScalarExpression.setImplicitReferencedOperator(Operator implicitReferencedOperator) |
Constructor and Description |
---|
ProjectExpression(OperatorPlan plan,
int inputNum,
java.lang.String alias,
Operator projectedOp,
LogicalRelationalOperator attachedRelationalOp)
Adds projection to the plan.
|
ScalarExpression(OperatorPlan plan,
Operator implicitReferencedOperator,
Operator attachedLogicalOperator) |
Constructor and Description |
---|
ExpToPhyTranslationVisitor(OperatorPlan plan,
LogicalRelationalOperator op,
PhysicalPlan phyPlan,
java.util.Map<Operator,PhysicalOperator> map) |
ExpToPhyTranslationVisitor(OperatorPlan plan,
PlanWalker walker,
LogicalRelationalOperator op,
PhysicalPlan phyPlan,
java.util.Map<Operator,PhysicalOperator> map) |
Modifier and Type | Class and Description |
---|---|
class |
LOCogroup |
class |
LOCross |
class |
LOCube
CUBE operator implementation for data cube computation.
|
class |
LODistinct |
class |
LOFilter |
class |
LOForEach |
class |
LOGenerate |
class |
LogicalRelationalOperator
Logical representation of relational operators.
|
class |
LOInnerLoad
Operator to map the data into the inner plan of LOForEach
It can only be used in the inner plan of LOForEach
|
class |
LOJoin |
class |
LOLimit |
class |
LOLoad |
class |
LONative |
class |
LORank
RANK operator implementation.
|
class |
LOSort |
class |
LOSplit |
class |
LOSplitOutput |
class |
LOStore |
class |
LOStream |
class |
LOUnion |
Modifier and Type | Field and Description |
---|---|
protected java.util.Map<Operator,PhysicalOperator> |
LogToPhyTranslationVisitor.logToPhyMap |
Modifier and Type | Method and Description |
---|---|
Operator |
LogicalPlan.findByAlias(java.lang.String alias) |
Operator |
LOSort.getInput(LogicalPlan plan) |
Operator |
LOLimit.getInput(LogicalPlan plan) |
Operator |
LOFilter.getInput(LogicalPlan plan) |
Operator |
LODistinct.getInput(LogicalPlan plan) |
Modifier and Type | Method and Description |
---|---|
java.util.List<Operator> |
LOUnion.getInputs() |
java.util.List<Operator> |
LOCross.getInputs() |
java.util.List<Operator> |
LOUnion.getInputs(LogicalPlan plan) |
java.util.List<Operator> |
LOJoin.getInputs(LogicalPlan plan) |
java.util.List<Operator> |
LOCube.getInputs(LogicalPlan plan) |
java.util.List<Operator> |
LOCogroup.getInputs(LogicalPlan plan) |
java.util.Map<Operator,PhysicalOperator> |
LogToPhyTranslationVisitor.getLogToPhyMap() |
Modifier and Type | Method and Description |
---|---|
boolean |
LOUnion.isEqual(Operator other) |
boolean |
LOStream.isEqual(Operator other) |
boolean |
LOStore.isEqual(Operator other) |
boolean |
LOSplitOutput.isEqual(Operator other) |
boolean |
LOSplit.isEqual(Operator other) |
boolean |
LOSort.isEqual(Operator other) |
boolean |
LORank.isEqual(Operator other) |
boolean |
LONative.isEqual(Operator obj) |
boolean |
LOLoad.isEqual(Operator other) |
boolean |
LOLimit.isEqual(Operator other) |
boolean |
LOJoin.isEqual(Operator other) |
boolean |
LOInnerLoad.isEqual(Operator other) |
boolean |
LOGenerate.isEqual(Operator other) |
boolean |
LOForEach.isEqual(Operator other) |
boolean |
LOFilter.isEqual(Operator other) |
boolean |
LODistinct.isEqual(Operator other) |
boolean |
LOCube.isEqual(Operator other) |
boolean |
LOCross.isEqual(Operator other) |
boolean |
LOCogroup.isEqual(Operator other) |
static void |
LogToPhyTranslationVisitor.updateWithEmptyBagCheck(PhysicalPlan fePlan,
Operator joinInput)
updates plan with check for empty bag and if bag is empty to flatten a bag
with as many null's as dictated by the schema
|
Modifier and Type | Method and Description |
---|---|
boolean |
MapSideMergeValidator.validateMapSideMerge(java.util.List<Operator> preds,
OperatorPlan lp) |
Modifier and Type | Method and Description |
---|---|
java.util.Map<java.lang.String,Operator> |
QueryParserDriver.getOperators() |
Modifier and Type | Method and Description |
---|---|
static void |
QueryParserUtils.attachStorePlan(java.lang.String scope,
LogicalPlan lp,
java.lang.String fileName,
java.lang.String func,
Operator input,
java.lang.String alias,
PigContext pigContext) |
Modifier and Type | Method and Description |
---|---|
java.util.Map<Operator,DataBag> |
ExampleGenerator.getData() |
java.util.Map<Operator,DataBag> |
ExampleGenerator.getData(java.util.Map<LOLoad,DataBag> newBaseData) |
java.util.Map<Operator,DataBag> |
ExampleGenerator.getExamples() |
java.util.Map<Operator,PhysicalOperator> |
ExampleGenerator.getLogToPhyMap() |
Modifier and Type | Method and Description |
---|---|
static java.util.Map<LogicalRelationalOperator,java.util.Collection<IdentityHashSet<Tuple>>> |
EquivalenceClasses.getLoToEqClassMap(PhysicalPlan plan,
LogicalPlan lp,
java.util.Map<Operator,PhysicalOperator> logToPhyMap,
java.util.Map<Operator,DataBag> logToDataMap,
java.util.Map<LOForEach,java.util.Map<LogicalRelationalOperator,PhysicalOperator>> forEachInnerLogToPhyMap,
java.util.HashMap<PhysicalOperator,java.util.Collection<IdentityHashSet<Tuple>>> poToEqclassesMap) |
static java.util.Map<LogicalRelationalOperator,java.util.Collection<IdentityHashSet<Tuple>>> |
EquivalenceClasses.getLoToEqClassMap(PhysicalPlan plan,
LogicalPlan lp,
java.util.Map<Operator,PhysicalOperator> logToPhyMap,
java.util.Map<Operator,DataBag> logToDataMap,
java.util.Map<LOForEach,java.util.Map<LogicalRelationalOperator,PhysicalOperator>> forEachInnerLogToPhyMap,
java.util.HashMap<PhysicalOperator,java.util.Collection<IdentityHashSet<Tuple>>> poToEqclassesMap) |
Constructor and Description |
---|
AugmentBaseDataVisitor(OperatorPlan plan,
java.util.Map<Operator,PhysicalOperator> logToPhysMap,
java.util.Map<LOLoad,DataBag> baseData,
java.util.Map<Operator,DataBag> derivedData) |
AugmentBaseDataVisitor(OperatorPlan plan,
java.util.Map<Operator,PhysicalOperator> logToPhysMap,
java.util.Map<LOLoad,DataBag> baseData,
java.util.Map<Operator,DataBag> derivedData) |
LineageTrimmingVisitor(LogicalPlan plan,
java.util.Map<LOLoad,DataBag> baseData,
ExampleGenerator eg,
java.util.Map<Operator,PhysicalOperator> LogToPhyMap,
PhysicalPlan physPlan,
PigContext pc) |
Modifier and Type | Method and Description |
---|---|
static float |
MetricEvaluation.getCompleteness(Operator op,
java.util.Map<Operator,DataBag> exampleData,
java.util.Map<LogicalRelationalOperator,java.util.Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallCompleteness) |
static float |
MetricEvaluation.getConciseness(Operator op,
java.util.Map<Operator,DataBag> exampleData,
java.util.Map<LogicalRelationalOperator,java.util.Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallConciseness) |
static float |
MetricEvaluation.getRealness(Operator op,
java.util.Map<Operator,DataBag> exampleData,
boolean overallRealness) |
static void |
DisplayExamples.printSimple(Operator op,
LogicalPlan lp,
java.util.Map<Operator,DataBag> exampleData) |
Modifier and Type | Method and Description |
---|---|
static float |
MetricEvaluation.getCompleteness(Operator op,
java.util.Map<Operator,DataBag> exampleData,
java.util.Map<LogicalRelationalOperator,java.util.Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallCompleteness) |
static float |
MetricEvaluation.getConciseness(Operator op,
java.util.Map<Operator,DataBag> exampleData,
java.util.Map<LogicalRelationalOperator,java.util.Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallConciseness) |
static float |
MetricEvaluation.getRealness(Operator op,
java.util.Map<Operator,DataBag> exampleData,
boolean overallRealness) |
static void |
DisplayExamples.printSimple(Operator op,
LogicalPlan lp,
java.util.Map<Operator,DataBag> exampleData) |
static java.lang.String |
DisplayExamples.printTabular(LogicalPlan lp,
java.util.Map<Operator,DataBag> exampleData,
java.util.Map<LOForEach,java.util.Map<LogicalRelationalOperator,DataBag>> forEachInnerLogToDataMap) |
Modifier and Type | Class and Description |
---|---|
class |
JobStats
This class encapsulates the runtime statistics of a MapReduce job.
|
Modifier and Type | Method and Description |
---|---|
boolean |
PigStats.JobGraph.isConnected(Operator from,
Operator to) |
boolean |
JobStats.isEqual(Operator operator) |
Modifier and Type | Class and Description |
---|---|
class |
MRJobStats
This class encapsulates the runtime statistics of a MapReduce job.
|
Modifier and Type | Class and Description |
---|---|
class |
Spark1JobStats |
class |
Spark2JobStats |
class |
SparkJobStats |
Modifier and Type | Class and Description |
---|---|
class |
TezDAGStats |
class |
TezVertexStats |
Copyright © 2007-2017 The Apache Software Foundation