org.apache.pig.impl.streaming

Class ExecutableManager

java.lang.Object

org.apache.pig.impl.streaming.ExecutableManager

Direct Known Subclasses:

HadoopExecutableManager

public class ExecutableManager
extends java.lang.Object

ExecutableManager manages an external executable which processes data in a Pig query. The ExecutableManager is responsible for startup/teardown of the external process and also for managing it. It feeds input records to the executable via it's stdin, collects the output records from the stdout and also diagnostic information from the stdout.

Field Summary

Fields

Modifier and Type	Field and Description
protected StreamingCommand	command
protected int	exitCode
protected long	inputBytes
protected long	inputRecords
protected java.lang.Throwable	outerrThreadsError
protected long	outputBytes
protected long	outputRecords
protected java.io.DataOutputStream	stdin

Constructor Summary

Constructors

Constructor and Description
ExecutableManager() Create a new ExecutableManager.

Method Summary

Modifier and Type	Method and Description
void	close() Close and cleanup the ExecutableManager.
void	configure(POStream stream) Configure and initialize the ExecutableManager.
protected void	exec() Start execution of the external process.
protected void	processError(java.lang.String error) Workhorse to process the stderr stream of the managed process.
void	run() Start execution of the ExecutableManager.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

command

protected StreamingCommand command

exitCode

protected int exitCode

stdin

protected java.io.DataOutputStream stdin

inputRecords

protected long inputRecords

inputBytes

protected long inputBytes

outputRecords

protected long outputRecords

outputBytes

protected long outputBytes

outerrThreadsError

protected volatile java.lang.Throwable outerrThreadsError

Constructor Detail

ExecutableManager

public ExecutableManager()

Create a new ExecutableManager.

Method Detail

configure

public void configure(POStream stream)
               throws java.io.IOException,
                      ExecException

Configure and initialize the ExecutableManager.

Parameters:

stream - POStream operator

Throws:

java.io.IOException

ExecException

close

public void close()
           throws java.io.IOException

Close and cleanup the ExecutableManager.

Throws:

java.io.IOException

exec

protected void exec()
             throws java.io.IOException

Start execution of the external process. This takes care of setting up the environment of the process and also starts ProcessErrorThread to process the stderr of the managed process.

Throws:

java.io.IOException

run

public void run()
         throws java.io.IOException

Start execution of the ExecutableManager.

Throws:

java.io.IOException

processError

protected void processError(java.lang.String error)

Workhorse to process the stderr stream of the managed process. By default ExecuatbleManager just sends out the received error message to the stderr of itself.

Parameters:

error - error message from the managed process.