io.druid.firehose.google

Class StaticGoogleBlobStoreFirehoseFactory

java.lang.Object

io.druid.data.input.impl.AbstractTextFilesFirehoseFactory<T>

io.druid.data.input.impl.prefetch.PrefetchableTextFilesFirehoseFactory<GoogleBlob>

io.druid.firehose.google.StaticGoogleBlobStoreFirehoseFactory

All Implemented Interfaces:

FirehoseFactory<StringInputRowParser>

public class StaticGoogleBlobStoreFirehoseFactory
extends PrefetchableTextFilesFirehoseFactory<GoogleBlob>

Constructor Summary

Constructors

Constructor and Description
StaticGoogleBlobStoreFirehoseFactory(GoogleStorage storage, List<GoogleBlob> blobs, Long maxCacheCapacityBytes, Long maxFetchCapacityBytes, Long prefetchTriggerBytes, Long fetchTimeout, Integer maxFetchRetry)

Method Summary

Modifier and Type	Method and Description
boolean	equals(Object o)
List<GoogleBlob>	getBlobs()
int	hashCode()
protected Collection<GoogleBlob>	initObjects() Initialize objects to be read by this firehose.
protected InputStream	openObjectStream(GoogleBlob object) Open an input stream from the given object.
protected InputStream	wrapObjectStream(GoogleBlob object, InputStream stream) Wrap the given input stream if needed.

Methods inherited from class io.druid.data.input.impl.prefetch.PrefetchableTextFilesFirehoseFactory

connect, getFetchTimeout, getMaxCacheCapacityBytes, getMaxFetchCapacityBytes, getMaxFetchRetry, getPrefetchTriggerBytes

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.druid.data.input.FirehoseFactory

connect

Constructor Detail

StaticGoogleBlobStoreFirehoseFactory

public StaticGoogleBlobStoreFirehoseFactory(GoogleStorage storage,
                                            List<GoogleBlob> blobs,
                                            Long maxCacheCapacityBytes,
                                            Long maxFetchCapacityBytes,
                                            Long prefetchTriggerBytes,
                                            Long fetchTimeout,
                                            Integer maxFetchRetry)

Method Detail

getBlobs

public List<GoogleBlob> getBlobs()

initObjects

protected Collection<GoogleBlob> initObjects()

Description copied from class: AbstractTextFilesFirehoseFactory

Initialize objects to be read by this firehose. Since firehose factories are constructed whenever io.druid.indexing.common.task.Task objects are deserialized, actual initialization of objects is deferred until AbstractTextFilesFirehoseFactory.connect(StringInputRowParser, File) is called.

Specified by:

initObjects in class AbstractTextFilesFirehoseFactory<GoogleBlob>

Returns:

a collection of initialized objects.

openObjectStream

protected InputStream openObjectStream(GoogleBlob object)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Open an input stream from the given object. If the object is compressed, this method should return a byte stream as it is compressed. The object compression should be handled in AbstractTextFilesFirehoseFactory.wrapObjectStream(Object, InputStream).

Specified by:

openObjectStream in class AbstractTextFilesFirehoseFactory<GoogleBlob>

Parameters:

object - an object to be read

Returns:

an input stream for the object

Throws:

IOException

wrapObjectStream

protected InputStream wrapObjectStream(GoogleBlob object,
                                       InputStream stream)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Wrap the given input stream if needed. The decompression logic should be applied to the given stream if the object is compressed.

Specified by:

wrapObjectStream in class AbstractTextFilesFirehoseFactory<GoogleBlob>

Parameters:

object - an input object

stream - a stream for the object

Returns:

Throws:

IOException

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object