io.druid.firehose.azure

Class StaticAzureBlobStoreFirehoseFactory

java.lang.Object

io.druid.data.input.impl.AbstractTextFilesFirehoseFactory<T>

io.druid.data.input.impl.prefetch.PrefetchableTextFilesFirehoseFactory<AzureBlob>

io.druid.firehose.azure.StaticAzureBlobStoreFirehoseFactory

All Implemented Interfaces:

FirehoseFactory<StringInputRowParser>

public class StaticAzureBlobStoreFirehoseFactory
extends PrefetchableTextFilesFirehoseFactory<AzureBlob>

This class is heavily inspired by the StaticS3FirehoseFactory class in the io.druid.firehose.s3 package

Constructor Summary

Constructors

Constructor and Description
StaticAzureBlobStoreFirehoseFactory(AzureStorage azureStorage, List<AzureBlob> blobs, Long maxCacheCapacityBytes, Long maxFetchCapacityBytes, Long prefetchTriggerBytes, Long fetchTimeout, Integer maxFetchRetry)

Method Summary

Modifier and Type	Method and Description
boolean	equals(Object o)
List<AzureBlob>	getBlobs()
int	hashCode()
protected Collection<AzureBlob>	initObjects() Initialize objects to be read by this firehose.
protected InputStream	openObjectStream(AzureBlob object) Open an input stream from the given object.
protected InputStream	wrapObjectStream(AzureBlob object, InputStream stream) Wrap the given input stream if needed.

Methods inherited from class io.druid.data.input.impl.prefetch.PrefetchableTextFilesFirehoseFactory

connect, getFetchTimeout, getMaxCacheCapacityBytes, getMaxFetchCapacityBytes, getMaxFetchRetry, getPrefetchTriggerBytes

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.druid.data.input.FirehoseFactory

connect

Constructor Detail

StaticAzureBlobStoreFirehoseFactory

public StaticAzureBlobStoreFirehoseFactory(AzureStorage azureStorage,
                                           List<AzureBlob> blobs,
                                           Long maxCacheCapacityBytes,
                                           Long maxFetchCapacityBytes,
                                           Long prefetchTriggerBytes,
                                           Long fetchTimeout,
                                           Integer maxFetchRetry)

Method Detail

getBlobs

public List<AzureBlob> getBlobs()

initObjects

protected Collection<AzureBlob> initObjects()

Description copied from class: AbstractTextFilesFirehoseFactory

Initialize objects to be read by this firehose. Since firehose factories are constructed whenever io.druid.indexing.common.task.Task objects are deserialized, actual initialization of objects is deferred until AbstractTextFilesFirehoseFactory.connect(StringInputRowParser, File) is called.

Specified by:

initObjects in class AbstractTextFilesFirehoseFactory<AzureBlob>

Returns:

a collection of initialized objects.

openObjectStream

protected InputStream openObjectStream(AzureBlob object)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Open an input stream from the given object. If the object is compressed, this method should return a byte stream as it is compressed. The object compression should be handled in AbstractTextFilesFirehoseFactory.wrapObjectStream(Object, InputStream).

Specified by:

openObjectStream in class AbstractTextFilesFirehoseFactory<AzureBlob>

Parameters:

object - an object to be read

Returns:

an input stream for the object

Throws:

IOException

wrapObjectStream

protected InputStream wrapObjectStream(AzureBlob object,
                                       InputStream stream)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Wrap the given input stream if needed. The decompression logic should be applied to the given stream if the object is compressed.

Specified by:

wrapObjectStream in class AbstractTextFilesFirehoseFactory<AzureBlob>

Parameters:

object - an input object

stream - a stream for the object

Returns:

Throws:

IOException

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object