Modifier and Type | Class and Description |
---|---|
class |
AccumulatorEvalFunc<T>
This class is used to provide a free implementation of the EvalFunc exec function given
implementation of the Accumulator interface.
|
class |
AlgebraicEvalFunc<T>
This class is used to provide a free implementation of the Accumulator interface
and EvalFunc class in the case of an Algebraic function.
|
class |
FilterFunc |
class |
IteratingAccumulatorEvalFunc<T>
This class provides a much more intuitive way to write Accumulator UDFs.
For example, you could express IsEmpty as follows: |
class |
PrimitiveEvalFunc<IN,OUT>
Base class for simple Pig UDFs that are functions of primitive types IN to OUT.
|
class |
TypedOutputEvalFunc<OUT>
Base class for Pig UDFs that are functions from Tuples to generic type OUT.
|
Modifier and Type | Method and Description |
---|---|
EvalFunc |
POUserFunc.getFunc() |
Constructor and Description |
---|
POUserFunc(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
FuncSpec funcSpec,
EvalFunc func) |
Modifier and Type | Method and Description |
---|---|
static void |
MonitoredUDFExecutor.ErrorCallback.handleError(EvalFunc evalFunc,
java.lang.Exception e) |
static void |
MonitoredUDFExecutor.ErrorCallback.handleTimeout(EvalFunc evalFunc,
java.lang.Exception e) |
Constructor and Description |
---|
MonitoredUDFExecutor(EvalFunc udf) |
Modifier and Type | Class and Description |
---|---|
class |
FindQuantilesTez |
class |
IsFirstReduceOfKeyTez |
class |
PartitionSkewedKeysTez |
class |
ReadScalarsTez |
Modifier and Type | Class and Description |
---|---|
class |
ABS
ABS implements a binding to the Java function
Math.abs(double) for computing the
absolute value of the argument. |
class |
ACOS
ACOS implements a binding to the Java function
Math.acos(double) for computing the
arc cosine of value of the argument. |
class |
AddDuration
AddDuration returns the result of a DateTime object plus a Duration object
|
class |
AlgebraicBigDecimalMathBase
Core logic for applying an SUM function to a
bag of BigDecimals.
|
static class |
AlgebraicBigDecimalMathBase.Final |
static class |
AlgebraicBigDecimalMathBase.Intermediate |
class |
AlgebraicBigIntegerMathBase
Core logic for applying an SUM function to a
bag of BigIntegers.
|
static class |
AlgebraicBigIntegerMathBase.Final |
static class |
AlgebraicBigIntegerMathBase.Intermediate |
class |
AlgebraicByteArrayMathBase
Core logic for applying an accumulative/algebraic math function to a
bag of doubles.
|
static class |
AlgebraicByteArrayMathBase.Final |
static class |
AlgebraicByteArrayMathBase.Initial |
static class |
AlgebraicByteArrayMathBase.Intermediate |
class |
AlgebraicDoubleMathBase
Core logic for applying an accumulative/algebraic math function to a
bag of doubles.
|
static class |
AlgebraicDoubleMathBase.Final |
static class |
AlgebraicDoubleMathBase.Intermediate |
class |
AlgebraicFloatMathBase
Core logic for applying an accumulative/algebraic math function to a
bag of Floats.
|
static class |
AlgebraicFloatMathBase.Final |
static class |
AlgebraicFloatMathBase.Intermediate |
class |
AlgebraicIntMathBase
Core logic for applying an accumulative/algebraic math function to a
bag of doubles.
|
static class |
AlgebraicIntMathBase.Final |
static class |
AlgebraicIntMathBase.Intermediate |
class |
AlgebraicLongMathBase
Core logic for applying an accumulative/algebraic math function to a
bag of Longs.
|
static class |
AlgebraicLongMathBase.Final |
static class |
AlgebraicLongMathBase.Intermediate |
static class |
AlgebraicMathBase.Final<T> |
static class |
AlgebraicMathBase.Intermediate |
class |
ARITY
Deprecated.
Use
SIZE instead. |
class |
ASIN
ASIN implements a binding to the Java function
Math.asin(double) for computing the
arc sine of value of the argument. |
class |
Assert |
class |
ATAN
ATAN implements a binding to the Java function
Math.atan(double) for computing the
arc tangent of value of the argument. |
class |
AVG
Generates the average of a set of values.
|
static class |
AVG.Final |
static class |
AVG.Initial |
static class |
AVG.Intermediate |
class |
BagSize
This method should never be used directly, use
SIZE . |
class |
BagToString
Flatten a bag into a string.
|
class |
BagToTuple
Flatten a bag into a tuple.
|
class |
Base
base class for math udfs
|
class |
BigDecimalAbs |
class |
BigDecimalAvg
This method should never be used directly, use
AVG . |
static class |
BigDecimalAvg.Final |
static class |
BigDecimalAvg.Initial |
static class |
BigDecimalAvg.Intermediate |
class |
BigDecimalMax
This method should never be used directly, use
MAX . |
static class |
BigDecimalMax.Final |
static class |
BigDecimalMax.Intermediate |
class |
BigDecimalMin
This method should never be used directly, use
MIN . |
static class |
BigDecimalMin.Final |
static class |
BigDecimalMin.Intermediate |
class |
BigDecimalSum
This method should never be used directly, use
SUM . |
static class |
BigDecimalSum.Final |
static class |
BigDecimalSum.Intermediate |
class |
BigIntegerAbs |
class |
BigIntegerAvg
This method should never be used directly, use
AVG . |
static class |
BigIntegerAvg.Final |
static class |
BigIntegerAvg.Initial |
static class |
BigIntegerAvg.Intermediate |
class |
BigIntegerMax
This method should never be used directly, use
MAX . |
static class |
BigIntegerMax.Final |
static class |
BigIntegerMax.Intermediate |
class |
BigIntegerMin
This method should never be used directly, use
MIN . |
static class |
BigIntegerMin.Final |
static class |
BigIntegerMin.Intermediate |
class |
BigIntegerSum
This method should never be used directly, use
SUM . |
static class |
BigIntegerSum.Final |
static class |
BigIntegerSum.Intermediate |
class |
Bloom
Use a Bloom filter build previously by BuildBloom.
|
class |
BuildBloom
Build a bloom filter for use later in Bloom.
|
static class |
BuildBloom.Final |
static class |
BuildBloom.Initial |
static class |
BuildBloom.Intermediate |
class |
BuildBloomBase<T>
A Base class for BuildBloom and its Algebraic implementations.
|
class |
CBRT
CBRT implements a binding to the Java function
Math.cbrt(double) for computing the
cube root of the argument. |
class |
CEIL
CEIL implements a binding to the Java function
Math.ceil(double) . |
class |
CONCAT
Generates the concatenation of two or more arguments.
|
class |
ConstantSize
This method should never be used directly, use
SIZE . |
class |
COR
Computes the correlation between sets of data.
|
static class |
COR.Final |
static class |
COR.Initial |
static class |
COR.Intermed |
class |
COS
COS implements a binding to the Java function
Math.cos(double) . |
class |
COSH
COSH implements a binding to the Java function
Math.cosh(double) . |
class |
COUNT
Generates the count of the number of values in a bag.
|
class |
COUNT_STAR
Generates the count of the values of the first field of a tuple.
|
static class |
COUNT_STAR.Final |
static class |
COUNT_STAR.Initial |
static class |
COUNT_STAR.Intermediate |
static class |
COUNT.Final |
static class |
COUNT.Initial |
static class |
COUNT.Intermediate |
class |
COV
Computes the covariance between sets of data.
|
static class |
COV.Final |
static class |
COV.Initial |
static class |
COV.Intermed |
class |
CubeDimensions
Produces a DataBag with all combinations of the argument tuple members
as in a data cube.
|
class |
CurrentTime |
class |
DateTimeMax
This method should never be used directly, use
MAX . |
static class |
DateTimeMax.Final |
static class |
DateTimeMax.Initial |
static class |
DateTimeMax.Intermediate |
class |
DateTimeMin
This method should never be used directly, use
MAX . |
static class |
DateTimeMin.Final |
static class |
DateTimeMin.Initial |
static class |
DateTimeMin.Intermediate |
class |
DaysBetween
DaysBetween returns the number of days between two DateTime objects
|
class |
DIFF
DIFF takes two bags as arguments and compares them.
|
class |
Distinct
Find the distinct set of tuples in a bag.
|
static class |
Distinct.Final |
static class |
Distinct.Initial |
static class |
Distinct.Intermediate |
class |
DoubleAvg
This method should never be used directly, use
AVG . |
static class |
DoubleAvg.Final |
static class |
DoubleAvg.Initial |
static class |
DoubleAvg.Intermediate |
class |
DoubleBase
base class for math udfs that return Double value
|
static class |
DoubleMax.Final |
static class |
DoubleMax.Intermediate |
static class |
DoubleMin.Final |
static class |
DoubleMin.Intermediate |
class |
DoubleRound
Given a single data atom it Returns the closest long to the argument.
|
class |
DoubleRoundTo
ROUND_TO safely rounds a number to a given precision by using an intermediate
BigDecimal.
|
class |
DoubleSum
This method should never be used directly, use
SUM . |
static class |
DoubleSum.Final |
static class |
DoubleSum.Intermediate |
class |
ENDSWITH
Pig UDF to test input
tuple.get(0) against tuple.get(1)
to determine if the first argument ends with the string in the second. |
class |
EqualsIgnoreCase
Compares two Strings ignoring case considerations.
|
class |
EXP
Given a single data atom it returns the Euler's number e raised to the power of input
|
class |
FloatAbs |
class |
FloatAvg
This method should never be used directly, use
AVG . |
static class |
FloatAvg.Final |
static class |
FloatAvg.Initial |
static class |
FloatAvg.Intermediate |
static class |
FloatMax.Final |
static class |
FloatMax.Intermediate |
static class |
FloatMin.Final |
static class |
FloatMin.Intermediate |
class |
FloatRound
ROUND implements a binding to the Java function
Math.round(float) . |
class |
FloatRoundTo
ROUND_TO safely rounds a number to a given precision by using an intermediate
BigDecimal.
|
class |
FloatSum
This method should never be used directly, use
SUM . |
class |
FLOOR
FLOOR implements a binding to the Java function
Math.floor(double) . |
class |
FunctionWrapperEvalFunc
EvalFunc that wraps an implementation of the Function interface, which is passed as a String
in the constructor.
|
class |
GenericInvoker<T>
The generic Invoker class does all the common grunt work of setting up an invoker.
|
class |
GetDay
GetDay extracts the day of a month from a DateTime object.
|
class |
GetHour
GetHour extracts the hour of a day from a DateTime object.
|
class |
GetMilliSecond
GetSecond extracts the millisecond of a second from a DateTime object.
|
class |
GetMinute
GetMinute extracts the minute of an hour from a DateTime object.
|
class |
GetMonth
GetMonth extracts the month of a year from a DateTime object.
|
class |
GetSecond
GetSecond extracts the second of a minute from a DateTime object.
|
class |
GetWeek
GetMonth extracts the week of a week year from a DateTime object.
|
class |
GetWeekYear
GetMonth extracts the week year from a DateTime object.
|
class |
GetYear
GetYear extracts the year from a DateTime object.
|
class |
HiveUDAF
Use Hive UDAF or GenericUDAF.
|
static class |
HiveUDAF.Final |
static class |
HiveUDAF.Initial |
static class |
HiveUDAF.Intermediate |
class |
HiveUDF
Use Hive UDF or GenericUDF.
|
class |
HiveUDTF
Use Hive GenericUDTF.
|
class |
HoursBetween
HoursBetween returns the number of hours between two DateTime objects
|
class |
INDEXOF
INDEXOF implements eval function to search for a string
Example:
A = load 'mydata' as (name);
B = foreach A generate INDEXOF(name, ",");
|
class |
IntAbs
ABS implements a binding to the Java function
Math.abs(int) for computing the
absolute value of the argument. |
class |
IntAvg
This method should never be used directly, use
AVG . |
static class |
IntAvg.Final |
static class |
IntAvg.Initial |
static class |
IntAvg.Intermediate |
static class |
IntMax.Final |
static class |
IntMax.Intermediate |
static class |
IntMin.Final |
static class |
IntMin.Intermediate |
class |
IntSum
This method should never be used directly, use
SUM . |
class |
INVERSEMAP
This UDF accepts a Map as input with values of any primitive data type.
|
class |
InvokeForDouble |
class |
InvokeForFloat |
class |
InvokeForInt |
class |
InvokeForLong |
class |
InvokeForString |
class |
InvokerGenerator |
class |
IsEmpty
Determine whether a bag or map is empty.
|
class |
KEYSET
This UDF takes a Map and returns a Bag containing the keyset.
|
class |
LAST_INDEX_OF
string.INSTR implements eval function to search for the last occurrence of a string
Returns null on error
Example:
A = load 'mydata' as (name);
B = foreach A generate LASTINDEXOF(name, ",");
|
class |
LCFIRST
lower-case the first character of a string
|
class |
LOG
LOG implements a binding to the Java function
Math.log(double) . |
class |
LOG10
LOG10 implements a binding to the Java function
Math.log10(double) . |
class |
LongAbs |
class |
LongAvg
This method should never be used directly, use
AVG . |
static class |
LongAvg.Final |
static class |
LongAvg.Initial |
static class |
LongAvg.Intermediate |
static class |
LongMax.Final |
static class |
LongMax.Intermediate |
static class |
LongMin.Final |
static class |
LongMin.Intermediate |
class |
LongSum
This method should never be used directly, use
SUM . |
static class |
LongSum.Final |
static class |
LongSum.Intermediate |
class |
LOWER
LOWER implements eval function to convert a string to lower case
Example:
A = load 'mydata' as (name);
B = foreach A generate LOWER(name);
|
class |
LTRIM
Returns a string, with only leading whitespace omitted.
|
class |
MapSize
This method should never be used directly, use
SIZE . |
static class |
MAX.Final |
static class |
MAX.Intermediate |
class |
MilliSecondsBetween
MilliSecondsBetween returns the number of milliseconds between two DateTime objects
|
static class |
MIN.Final |
static class |
MIN.Intermediate |
class |
MinutesBetween
MinutesBetween returns the number of minutes between two DateTime objects
|
class |
MonthsBetween
MonthsBetween returns the number of months between two DateTime objects
|
class |
PluckTuple
This is a UDF which allows the user to specify a string prefix, and then
filter for the columns in a relation that begin with that prefix.
|
class |
RANDOM
Return a random double value.
|
class |
REGEX_EXTRACT
Syntax:
String RegexExtract(String expression, String regex, int match_index) .
Input:
expression -source string .
regex -regular expression .
match_index -index of the group to extract .
Output:
extracted group, if fail, return null .
Matching strategy:
Try to only match the first sequence by using Matcher.find() instead of
Matcher.matches() (default useMatches=false).
DEFINE NON_GREEDY_EXTRACT REGEX_EXTRACT('true');
|
class |
REGEX_EXTRACT_ALL
Syntax:
String RegexExtractAll(String expression, String regex) .
Input:
expression -source string .
regex -regular expression .
Output:
A tuple of matched strings .
Matching strategy:
Trying to match the entire input by using Matcher.matches() instead of
Matcher.find() (default useMatches=true).
DEFINE GREEDY_EXTRACT REGEX_EXTRACT_ALL('false');
|
class |
REGEX_SEARCH
Search and find all matched characters in a string with a given
regular expression.
|
class |
REPLACE
REPLACE implements eval function to replace part of a string.
|
class |
RollupDimensions
Produces a DataBag with hierarchy of values (from the most detailed level of
aggregation to most general level of aggregation) of the specified dimensions
For example, (a, b, c) will produce the following bag:
|
class |
ROUND
ROUND implements a binding to the Java function
Math.round(double) . |
class |
ROUND_TO
ROUND_TO safely rounds a number to a given precision by using an intermediate
BigDecimal.
|
class |
RTRIM
Returns a string, with only tailing whitespace omitted.
|
class |
SecondsBetween
SecondsBetween returns the number of seconds between two DateTime objects
|
class |
SIN
SIN implements a binding to the Java function
Math.sin(double) . |
class |
SINH
SINH implements a binding to the Java function
Math.sinh(double) . |
class |
SIZE
Generates the size of the argument passed to it.
|
class |
SPRINTF
Formatted strings using java.util.Formatter
See http://docs.oracle.com/javase/7/docs/api/java/util/Formatter.html
ex:
SPRINTF('%2$10s %1$-17s %2$,10d %2$8x %3$10.3f %4$1TFT%
|
class |
SQRT
SQRT implements a binding to the Java function
Math.sqrt(double) . |
class |
STARTSWITH
Pig UDF to test input
tuple.get(0) against tuple.get(1)
to determine if the first argument starts with the string in the second. |
class |
StringConcat
This method should never be used directly, use
CONCAT . |
class |
StringMax
This method should never be used directly, use
MAX . |
static class |
StringMax.Final |
static class |
StringMax.Initial |
static class |
StringMax.Intermediate |
class |
StringMin
This method should never be used directly, use
MIN . |
static class |
StringMin.Final |
static class |
StringMin.Initial |
static class |
StringMin.Intermediate |
class |
StringSize
This method should never be used directly, use
SIZE . |
class |
STRSPLIT
Wrapper around Java's String.split
input tuple: first column is assumed to have a string to split; the optional second column is assumed to have the delimiter or regex to split on; if not provided, it's assumed to be '\s' (space) the optional third column may provide a limit to the number of results. If limit is not provided, 0 is assumed, as per Java's split(). |
class |
STRSPLITTOBAG
Wrapper around Java's String.split
input tuple: first column is assumed to have a string to split; the optional second column is assumed to have the delimiter or regex to split on; if not provided, it's assumed to be '\s' (space) the optional third column may provide a limit to the number of results. If limit is not provided, 0 is assumed, as per Java's split(). |
class |
SUBSTRING
SUBSTRING implements eval function to get a part of a string.
|
class |
SUBTRACT
SUBTRACT takes two bags as arguments and returns a new bag composed of tuples of first bag not in the second bag.
If null, bag arguments are replaced by empty bags. |
class |
SubtractDuration
SubtractDuration returns the result of a DateTime object plus a Duration object
|
class |
SUM
Generates the sum of a set of values.
|
static class |
SUM.Final |
static class |
SUM.Intermediate |
class |
TAN
TAN implements a binding to the Java function
Math.tan(double) . |
class |
TANH
TANH implements a binding to the Java function
Math.tanh(double) . |
class |
TOBAG
This class takes a list of items and puts them into a bag
T = foreach U generate TOBAG($0, $1, $2);
It's like saying this:
T = foreach U generate {($0), ($1), ($2)}
All arguments that are not of tuple type are inserted into a tuple before
being added to the bag.
|
class |
ToDate
ToDate converts the ISO or the customized string or the Unix timestamp to the DateTime object.
|
class |
ToDate2ARGS
This method should never be used directly, use
ToDate . |
class |
ToDate3ARGS
This method should never be used directly, use
ToDate . |
class |
ToDateISO
This method should never be used directly, use
ToDate . |
class |
TOKENIZE
Given a chararray as an argument, this method will split the chararray and
return a bag with a tuple for each chararray that results from the split.
|
class |
TOMAP
This class makes a map out of the parameters passed to it
T = foreach U generate TOMAP($0, $1, $2, $3);
It generates a map $0->1, $2->$3
This UDF also accepts a bag with 'pair' tuples (i.e.
|
class |
ToMilliSeconds
ToMilliSeconds converts the DateTime to the number of milliseconds that have passed
since January 1, 1970 00:00:00.000 GMT.
|
class |
TOP
Top UDF accepts a bag of tuples and returns top-n tuples depending upon the
tuple field value of type long.
|
static class |
TOP.Final |
static class |
TOP.Initial |
static class |
TOP.Intermed |
class |
ToString
ToString converts the DateTime object of the ISO or the customized string.
|
class |
TOTUPLE
This class makes a tuple out of the parameter
T = foreach U generate TOTUPLE($0, $1, $2);
It generates a tuple containing $0, $1, and $2
|
class |
ToUnixTime
ToUnixTime converts the DateTime to the Unix Time Long
|
class |
TRIM
Returns a string, with leading and trailing whitespace omitted.
|
class |
TupleSize
This method should never be used directly, use
SIZE . |
class |
UCFIRST
upper-case the first character of a string
|
class |
UniqueID
UniqueID generates a unique id for each records in the job.
|
class |
UPPER
UPPER implements eval function to convert a string to upper case
Example:
A = load 'mydata' as (name);
B = foreach A generate UPPER(name);
|
class |
VALUELIST
This UDF takes a Map and returns a Bag containing the values from map.
|
class |
VALUESET
This UDF takes a Map and returns a Tuple containing the value set.
|
class |
WeeksBetween
WeeksBetween returns the number of weeks between two DateTime objects
|
class |
YearsBetween
YearsBetween returns the number of years between two DateTime objects
|
Modifier and Type | Class and Description |
---|---|
class |
FindQuantiles |
class |
GetMemNumRows
UDF to get memory size of a tuple and extracts number of rows value from
special tuple created by PoissonSampleLoader
It is used by skewed join.
|
class |
GFAny
built-in grouping function; permits system to choose any grouping.
|
class |
GFCross |
class |
GFReplicate |
class |
IdentityColumn
Returns the input, used by DuplicateForEachColumnRewrite
to rewrite duplicate columns in ForEach.
|
class |
IsFirstReduceOfKey |
class |
PartitionSkewedKeys
Partition reducers for skewed keys.
|
class |
ReadScalars
ReadScalars reads a line from a file and returns it as its value.
|
class |
StreamingUDF |
Modifier and Type | Method and Description |
---|---|
EvalFunc<?> |
UserFuncExpression.getEvalFunc() |
Modifier and Type | Class and Description |
---|---|
class |
ExtremalTupleByNthField
This class is similar to MaxTupleBy1stField except that it allows you to
specify with field to use (instead of just using 1st field) and to specify
ascending or descending.
|
static class |
ExtremalTupleByNthField.HelperClass
Utility classes and methods
|
class |
IsDouble
This UDF is used to check whether the String input is a Double.
|
class |
IsFloat
This UDF is used to check whether the String input is a Float.
|
class |
IsInt
This UDF is used to check whether the String input is an Integer.
|
class |
IsLong
This UDF is used to check whether the String input is a Long.
|
class |
IsNumeric
This UDF is used to check if a String is numeric.
|
class |
MaxTupleBy1stField
MaxTupleBy1stField UDF returns a tuple with max value of the first field in a
given bag.
|
static class |
MaxTupleBy1stField.Final |
static class |
MaxTupleBy1stField.Initial |
static class |
MaxTupleBy1stField.Intermediate |
class |
Over
Given an aggregate function, a bag, and possibly a window definition,
produce output that matches SQL OVER.
|
class |
Stitch
Given a set of bags, stitch them together tuple by tuple.
|
Modifier and Type | Class and Description |
---|---|
class |
DiffDate
Syntax:
int DiffDate(String yyyymmdd1, String yyyymmdd2) .
Input:
date string in "yyyymmdd" format .
Output:
(date1-date2) in days, can be negative .
|
Modifier and Type | Class and Description |
---|---|
class |
CustomFormatToISO
CustomFormatToISO converts arbitrary date formats to ISO format.
|
class |
ISOToUnix
ISOToUnix converts ISO8601 datetime strings to Unix Time Longs
|
class |
UnixToISO
UnixToISO converts Unix Time Long datetimes to ISO8601 datetime strings
|
Modifier and Type | Class and Description |
---|---|
class |
ISODaysBetween
ISODaysBetween returns the number of days between two ISO8601 datetimes as a Long
|
class |
ISOHoursBetween
ISOHoursBetween returns the number of hours between two ISO8601 datetimes as a Long
|
class |
ISOMinutesBetween
ISOMinutesBetween returns the number of minutes between two ISO8601 datetimes as a Long
|
class |
ISOMonthsBetween
ISOMonthsBetween returns the number of months between two ISO8601 datetimes as a Long
|
class |
ISOSecondsBetween
ISOSecondsBetween returns the number of seconds between two ISO8601 datetimes as a Long
|
class |
ISOYearsBetween |
Modifier and Type | Class and Description |
---|---|
class |
ISOToDay
ISOToDay truncates an ISO8601 datetime string to the precision of the day field
Jodatime: http://joda-time.sourceforge.net/
ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601
|
class |
ISOToHour
ISOToHour truncates an ISO8601 datetime string to the precision of the hour field
Jodatime: http://joda-time.sourceforge.net/
ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601
|
class |
ISOToMinute
ISOToMinute truncates an ISO8601 datetime string to the precision of the minute field
Jodatime: http://joda-time.sourceforge.net/
ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601
|
class |
ISOToMonth
ISOToMonth truncates an ISO8601 datetime string to the precision of the month field
Jodatime: http://joda-time.sourceforge.net/
ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601
|
class |
ISOToSecond
ISOToSecond truncates an ISO8601 datetime string to the precision of the second field
Jodatime: http://joda-time.sourceforge.net/
ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601
|
class |
ISOToWeek
ISOToWeek truncates an ISO8601 datetime string to the precision of the day field,
for the first day of the week of the datetime.
|
class |
ISOToYear |
Modifier and Type | Class and Description |
---|---|
class |
Bin
Syntax:
String Bin(arithmetic_expression, string1, ,..., stringN, sentinelN, default_string) .
Logic:
if (arithmetic_expression<=sentinel1) return string1; |
class |
BinCond
Syntax:
String BinCond(boolean_expression1, mapping_string1, ..., boolean_expressionN, mapping_stringN, other_string) .
Logic:
if (boolean_expression1) return mapping_string1; |
class |
Decode
Syntax:
String Decode(expression, value1, mapping_string1, ..., valueN, mapping_stringN, other_string) .
Logic:
if (expression==value1) return mapping_string1; |
Modifier and Type | Class and Description |
---|---|
class |
ATAN2
math.ATAN2 implements a binding to the Java function
Math.atan2(double,double) . |
class |
copySign
math.copySign implements a binding to the Java function
Math.copySign(double,double) . |
class |
DoubleAbs
Deprecated.
Use
DoubleAbs |
class |
DoubleCopySign
math.copySign implements a binding to the Java function
Math.copySign(double,double) . |
class |
DoubleDoubleBase
base class for math udfs that return Double value
|
class |
DoubleGetExponent
math.getExponent implements a binding to the Java function
Math.getExponent(double) . |
class |
DoubleMax
math.max implements a binding to the Java function
Math.max(int,int) for computing the
the max value of the arguments. |
class |
DoubleMin
math.min implements a binding to the Java function
Math.min(int,int) for computing the
the min value of the arguments. |
class |
DoubleNextAfter
math.nextAfter implements a binding to the Java function
Math.nextAfter(double,double) . |
class |
DoubleNextup
math.NEXTUP implements a binding to the Java function
Math.nextUp(double) . |
class |
DoubleSignum
math.SIGNUM implements a binding to the Java function
Math.signum(double) . |
class |
DoubleUlp
math.ULP implements a binding to the Java function
Math.ulp(double) . |
class |
EXPM1
math.EXPM1 implements a binding to the Java function
Math.expm1(double) . |
class |
FloatCopySign
math.copySign implements a binding to the Java function
Math.copySign(float,float) . |
class |
FloatGetExponent
math.getExponent implements a binding to the Java function
Math.getExponent(double) . |
class |
FloatMax
math.max implements a binding to the Java function
Math.max(int,int) for computing the
the max value of the arguments. |
class |
FloatMin
math.min implements a binding to the Java function
Math.min(int,int) for computing the
the min value of the arguments. |
class |
FloatNextAfter
math.nextAfter implements a binding to the Java function
Math.nextAfter(double,double) . |
class |
FloatNextup
math.NEXTUP implements a binding to the Java function
Math.nextUp(double) . |
class |
FloatSignum
math.SIGNUM implements a binding to the Java function
Math.signum(float) . |
class |
FloatUlp
math.ULP implements a binding to the Java function
Math.ulp(float) . |
class |
getExponent
math.getExponent implements a binding to the Java function
Math.getExponent(double) . |
class |
HYPOT
math.HYPOT implements a binding to the Java function
Math.hypot(double,double) . |
class |
IEEEremainder
math.IEEEremainder implements a binding to the Java function
Math.IEEEremainder(double,double) . |
class |
IntMax
math.max implements a binding to the Java function
Math.max(int,int) for computing the
the max value of the arguments. |
class |
IntMin
math.min implements a binding to the Java function
Math.min(int,int) for computing the
the min value of the arguments. |
class |
LOG1P
math.LOG1P implements a binding to the Java function
Math.log1p(double) . |
class |
LongMax
math.max implements a binding to the Java function
Math.max(long,long) for computing the
the max value of the arguments. |
class |
LongMin
math.min implements a binding to the Java function
Math.min(long,long) for computing the
the min value of the arguments. |
class |
MAX
math.MAX implements a binding to the Java function
Math.max(double,double) . |
class |
MIN
math.MIN implements a binding to the Java function
Math.min(double,double) . |
class |
nextAfter
math.nextAfter implements a binding to the Java function
Math.nextAfter(double,double) . |
class |
NEXTUP
math.NEXTUP implements a binding to the Java function
Math.nextUp(double) . |
class |
POW
math.POW implements a binding to the Java function
Math.pow(double,double) . |
class |
RINT
math.RINT implements a binding to the Java function
Math.rint(double) . |
class |
SCALB
math.SCALB implements a binding to the Java function
Math.scalb(double,int) . |
class |
SIGNUM
math.SIGNUM implements a binding to the Java function
Math.signum(double) . |
class |
toDegrees
math.toDegrees implements a binding to the Java function
Math.toDegrees(double) . |
class |
toRadians
math.toRadians implements a binding to the Java function
Math.toRadians(double) . |
class |
ULP
math.ULP implements a binding to the Java function
Math.ulp(double) . |
Modifier and Type | Class and Description |
---|---|
class |
HashFNV
Syntax:
long HashFNV(String string_to_hash, [int mod]) .
|
class |
HashFNV1
Implementation for HashFNV which takes 1 parameter
|
class |
HashFNV2
Implementation for HashFNV which takes 2 parameter
|
class |
LASTINDEXOF
Deprecated.
Use
LAST_INDEX_OF |
class |
LcFirst
Deprecated.
Use
LCFIRST |
class |
LENGTH
string.LENGTH implements eval function to find length of a string
Example:
register piggybank.jar;
A = load 'mydata' as (name);
B = foreach A generate string.LENGTH(name);
dump B;
|
class |
LookupInFiles
Syntax:
int lookupInFiles(String expression,... |
class |
RegexExtract
Deprecated.
Use
REGEX_EXTRACT |
class |
RegexExtractAll
Deprecated.
|
class |
RegexMatch
Syntax:
int RegexMatch(String expression, String regex) .
Output:
return 1 if expression contains regex, 0 otherwise .
|
class |
REPLACE_MULTI
REPLACE_MULTI implements eval function to replace all occurrences of search
keys with replacement values.
|
class |
Reverse |
class |
Split
Deprecated.
Use
STRSPLIT |
class |
Stuff
Given a string, this UDF replaces a substring given its starting index and
length with the given replacement string.
|
class |
Trim
Deprecated.
Use
TRIM |
class |
UcFirst
Deprecated.
Use
UCFIRST |
Modifier and Type | Class and Description |
---|---|
class |
SearchQuery
This small UDF takes a search engine URL (Google/Yahoo/AOL/Live) containing
the search query and extracts it.
|
class |
ToBag
Deprecated.
Use
TOBAG |
class |
Top
Deprecated.
Use
TOP |
static class |
Top.Final
Deprecated.
|
static class |
Top.Initial
Deprecated.
|
static class |
Top.Intermed
Deprecated.
|
class |
ToTuple
Deprecated.
Use
TOTUPLE |
Modifier and Type | Class and Description |
---|---|
class |
DateExtractor
DateExtractor has four different constructors which each allow for different functionality.
|
class |
HostExtractor
HostExtractor takes a url and returns the host.
|
class |
SearchEngineExtractor
SearchEngineExtractor takes a url string and extracts the search engine.
|
class |
SearchTermExtractor
SearchTermExtractor takes a url string and extracts the search terms.
|
Modifier and Type | Class and Description |
---|---|
class |
XPath
XPath is a function that allows for text extraction from xml
|
class |
XPathAll
XPathAll is a function that allows for Tuple extraction from xml
|
Modifier and Type | Class and Description |
---|---|
class |
JrubyAccumulatorEvalFunc
This class provides a bridge between Ruby classes that extend AccumulatorPigUdf
and their execution in Pig.
|
class |
JrubyAlgebraicEvalFunc<T>
This class provides the bridge between Ruby classes that extend the AlgebraicPigUdf
"interface" by implementing an initial, intermed, and final method.
|
static class |
JrubyAlgebraicEvalFunc.AlgebraicFunctionWrapper<T>
This is a lightweight wrapper shell that registers information on the method being called,
and provides the initializer that the static Algebraic classes (Initial, Intermed, Final)
will use to execute.
|
static class |
JrubyAlgebraicEvalFunc.BagJrubyAlgebraicEvalFunc
Unlike EvalFuncs and Accumulators, the type must be known at compile time (ie it
can't return Object), as Pig inspects the type and ensures that it is valid.
|
static class |
JrubyAlgebraicEvalFunc.BagJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.ChararrayJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.ChararrayJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.DataByteArrayJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.DataByteArrayJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.DoubleJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.DoubleJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.Final<T>
This class invokes the final method on the given Ruby class.
|
static class |
JrubyAlgebraicEvalFunc.FloatJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.FloatJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.Initial
This class invokes the initial method on the given Ruby class.
|
static class |
JrubyAlgebraicEvalFunc.IntegerJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.IntegerJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.Intermed
This class invokes the intermed method on the given Ruby class.
|
static class |
JrubyAlgebraicEvalFunc.LongJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.LongJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.MapJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.MapJrubyAlgebraicEvalFunc.Final |
static class |
JrubyAlgebraicEvalFunc.TupleJrubyAlgebraicEvalFunc |
static class |
JrubyAlgebraicEvalFunc.TupleJrubyAlgebraicEvalFunc.Final |
class |
JrubyEvalFunc
This class serves at the bridge between Ruby methods that
are registered with and extend PigUdf, and their execution in
Pig.
|
Modifier and Type | Class and Description |
---|---|
class |
JsFunction |
Modifier and Type | Class and Description |
---|---|
class |
JythonFunction
Python implementation of a Pig UDF Performs mappings between Python & Pig
data structures
|
Copyright © 2007-2017 The Apache Software Foundation