org.apache.flume.sink.kite

Class DatasetSink

java.lang.Object

org.apache.flume.sink.AbstractSink

org.apache.flume.sink.kite.DatasetSink

All Implemented Interfaces:

BatchSizeSupported, Configurable, LifecycleAware, NamedComponent, Sink

public class DatasetSink
extends AbstractSink
implements Configurable, BatchSizeSupported

Sink that writes events to a Kite Dataset. This sink will parse the body of each incoming event and store the resulting entity in a Kite Dataset. It determines the destination Dataset by opening a dataset URI kite.dataset.uri or opening a repository URI, kite.repo.uri, and loading a Dataset by name, kite.dataset.name, and namespace, kite.dataset.namespace.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flume.Sink

Sink.Status

Constructor Summary

Constructors

Constructor and Description
DatasetSink()

Method Summary

Modifier and Type	Method and Description
protected List<String>	allowedFormats() Return the list of allowed formats.
void	configure(Context context) Request the implementing class to (re)configure itself.
long	getBatchSize() Returns the batch size
Sink.Status	process() Requests the sink to attempt to consume data from attached channel
void	start() Starts a service or component.
void	stop() Stops a service or component.

Methods inherited from class org.apache.flume.sink.AbstractSink

getChannel, getLifecycleState, getName, setChannel, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DatasetSink

public DatasetSink()

Method Detail

allowedFormats

protected List<String> allowedFormats()

Return the list of allowed formats.

Returns:

The list of allowed formats.

configure

public void configure(Context context)

Description copied from interface: Configurable

Request the implementing class to (re)configure itself.

When configuration parameters are changed, they must be reflected by the component asap.

There are no thread safety guarantees on when configure might be called.

Specified by:

configure in interface Configurable

start

public void start()

Description copied from interface: LifecycleAware

Starts a service or component.

Implementations should determine the result of any start logic and effect the return value of LifecycleAware.getLifecycleState() accordingly.

Specified by:

start in interface LifecycleAware

Overrides:

start in class AbstractSink

stop

public void stop()

Description copied from interface: LifecycleAware

Stops a service or component.

Implementations should determine the result of any stop logic and effect the return value of LifecycleAware.getLifecycleState() accordingly.

Specified by:

stop in interface LifecycleAware

Overrides:

stop in class AbstractSink

process

public Sink.Status process()
                    throws EventDeliveryException

Description copied from interface: Sink

Requests the sink to attempt to consume data from attached channel

Note: This method should be consuming from the channel within the bounds of a Transaction. On successful delivery, the transaction should be committed, and on failure it should be rolled back.

Specified by:

process in interface Sink

Returns:

READY if 1 or more Events were successfully delivered, BACKOFF if no data could be retrieved from the channel feeding this sink

Throws:

EventDeliveryException - In case of any kind of failure to deliver data to the next hop destination.

getBatchSize

public long getBatchSize()

Description copied from interface: BatchSizeSupported

Returns the batch size

Specified by:

getBatchSize in interface BatchSizeSupported