io.druid.segment.realtime.firehose

Class LocalFirehoseFactory

java.lang.Object

io.druid.data.input.impl.AbstractTextFilesFirehoseFactory<File>

io.druid.segment.realtime.firehose.LocalFirehoseFactory

All Implemented Interfaces:

FirehoseFactory<StringInputRowParser>

public class LocalFirehoseFactory
extends AbstractTextFilesFirehoseFactory<File>

Constructor Summary

Constructors

Constructor and Description
LocalFirehoseFactory(File baseDir, String filter, StringInputRowParser parser)

Method Summary

Modifier and Type	Method and Description
File	getBaseDir()
String	getFilter()
StringInputRowParser	getParser()
protected Collection<File>	initObjects() Initialize objects to be read by this firehose.
protected InputStream	openObjectStream(File object) Open an input stream from the given object.
protected InputStream	wrapObjectStream(File object, InputStream stream) Wrap the given input stream if needed.

Methods inherited from class io.druid.data.input.impl.AbstractTextFilesFirehoseFactory

connect

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.druid.data.input.FirehoseFactory

connect

Constructor Detail

LocalFirehoseFactory

public LocalFirehoseFactory(File baseDir,
                            String filter,
                            StringInputRowParser parser)

Method Detail

getBaseDir

public File getBaseDir()

getFilter

public String getFilter()

getParser

public StringInputRowParser getParser()

initObjects

protected Collection<File> initObjects()

Description copied from class: AbstractTextFilesFirehoseFactory

Initialize objects to be read by this firehose. Since firehose factories are constructed whenever io.druid.indexing.common.task.Task objects are deserialized, actual initialization of objects is deferred until AbstractTextFilesFirehoseFactory.connect(StringInputRowParser, File) is called.

Specified by:

initObjects in class AbstractTextFilesFirehoseFactory<File>

Returns:

a collection of initialized objects.

openObjectStream

protected InputStream openObjectStream(File object)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Open an input stream from the given object. If the object is compressed, this method should return a byte stream as it is compressed. The object compression should be handled in AbstractTextFilesFirehoseFactory.wrapObjectStream(Object, InputStream).

Specified by:

openObjectStream in class AbstractTextFilesFirehoseFactory<File>

Parameters:

object - an object to be read

Returns:

an input stream for the object

Throws:

IOException

wrapObjectStream

protected InputStream wrapObjectStream(File object,
                                       InputStream stream)
                                throws IOException

Description copied from class: AbstractTextFilesFirehoseFactory

Wrap the given input stream if needed. The decompression logic should be applied to the given stream if the object is compressed.

Specified by:

wrapObjectStream in class AbstractTextFilesFirehoseFactory<File>

Parameters:

object - an input object

stream - a stream for the object

Returns:

Throws:

IOException