io.druid.firehose.cloudfiles

Class StaticCloudFilesFirehoseFactory

java.lang.Object

io.druid.data.input.impl.AbstractTextFilesFirehoseFactory<T>

io.druid.data.input.impl.prefetch.PrefetchableTextFilesFirehoseFactory<CloudFilesBlob>

io.druid.firehose.cloudfiles.StaticCloudFilesFirehoseFactory

All Implemented Interfaces:

FirehoseFactory<StringInputRowParser>

public class StaticCloudFilesFirehoseFactory
extends PrefetchableTextFilesFirehoseFactory<CloudFilesBlob>

Constructor Summary

Constructors

Constructor and Description
StaticCloudFilesFirehoseFactory(org.jclouds.rackspace.cloudfiles.v1.CloudFilesApi cloudFilesApi, List<CloudFilesBlob> blobs, Long maxCacheCapacityBytes, Long maxFetchCapacityBytes, Long prefetchTriggerBytes, Long fetchTimeout, Integer maxFetchRetry)

Method Summary

Modifier and Type	Method and Description
boolean	equals(Object o)
List<CloudFilesBlob>	getBlobs()
int	hashCode()
protected Collection<CloudFilesBlob>	initObjects() Initialize objects to be read by this firehose.
protected InputStream	openObjectStream(CloudFilesBlob object) Open an input stream from the given object.
protected InputStream	wrapObjectStream(CloudFilesBlob object, InputStream stream) Wrap the given input stream if needed.

Methods inherited from class io.druid.data.input.impl.prefetch.PrefetchableTextFilesFirehoseFactory

connect, getFetchTimeout, getMaxCacheCapacityBytes, getMaxFetchCapacityBytes, getMaxFetchRetry, getPrefetchTriggerBytes

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.druid.data.input.FirehoseFactory

connect

Constructor Detail

StaticCloudFilesFirehoseFactory

public StaticCloudFilesFirehoseFactory(org.jclouds.rackspace.cloudfiles.v1.CloudFilesApi cloudFilesApi,
                                       List<CloudFilesBlob> blobs,
                                       Long maxCacheCapacityBytes,
                                       Long maxFetchCapacityBytes,
                                       Long prefetchTriggerBytes,
                                       Long fetchTimeout,
                                       Integer maxFetchRetry)

Method Detail

getBlobs

public List<CloudFilesBlob> getBlobs()

initObjects

protected Collection<CloudFilesBlob> initObjects()

Description copied from class: AbstractTextFilesFirehoseFactory

Initialize objects to be read by this firehose. Since firehose factories are constructed whenever io.druid.indexing.common.task.Task objects are deserialized, actual initialization of objects is deferred until AbstractTextFilesFirehoseFactory.connect(StringInputRowParser, File) is called.

Specified by:

initObjects in class AbstractTextFilesFirehoseFactory<CloudFilesBlob>

Returns:

a collection of initialized objects.

openObjectStream

protected InputStream openObjectStream(CloudFilesBlob object)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Open an input stream from the given object. If the object is compressed, this method should return a byte stream as it is compressed. The object compression should be handled in AbstractTextFilesFirehoseFactory.wrapObjectStream(Object, InputStream).

Specified by:

openObjectStream in class AbstractTextFilesFirehoseFactory<CloudFilesBlob>

Parameters:

object - an object to be read

Returns:

an input stream for the object

Throws:

IOException

wrapObjectStream

protected InputStream wrapObjectStream(CloudFilesBlob object,
                                       InputStream stream)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Wrap the given input stream if needed. The decompression logic should be applied to the given stream if the object is compressed.

Specified by:

wrapObjectStream in class AbstractTextFilesFirehoseFactory<CloudFilesBlob>

Parameters:

object - an input object

stream - a stream for the object

Returns:

Throws:

IOException

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object