io.druid.segment.realtime.firehose

Class ReplayableFirehoseFactory

java.lang.Object

io.druid.segment.realtime.firehose.ReplayableFirehoseFactory

All Implemented Interfaces:

FirehoseFactory<InputRowParser>

public class ReplayableFirehoseFactory
extends Object
implements FirehoseFactory<InputRowParser>

Creates a wrapper firehose that writes from another firehose to disk and then serves nextRow() from disk. Useful for tasks that require multiple passes through the data to prevent multiple remote fetches. Also has support for retrying fetches if the underlying firehose throws an exception while the local cache is being generated.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	ReplayableFirehoseFactory.ReplayableFirehose

Constructor Summary

Constructors

Constructor and Description
ReplayableFirehoseFactory(FirehoseFactory delegateFactory, Boolean reportParseExceptions, Integer maxTempFileSize, Integer readFirehoseRetries, com.fasterxml.jackson.databind.ObjectMapper smileMapper)

Method Summary

Modifier and Type	Method and Description
Firehose	connect(InputRowParser parser) Initialization method that connects up the fire hose.
FirehoseFactory	getDelegateFactory()
int	getMaxTempFileSize()
int	getReadFirehoseRetries()
boolean	isReportParseExceptions()
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ReplayableFirehoseFactory

public ReplayableFirehoseFactory(FirehoseFactory delegateFactory,
                                 Boolean reportParseExceptions,
                                 Integer maxTempFileSize,
                                 Integer readFirehoseRetries,
                                 com.fasterxml.jackson.databind.ObjectMapper smileMapper)

Method Detail

connect

public Firehose connect(InputRowParser parser)
                 throws IOException

Description copied from interface: FirehoseFactory

Initialization method that connects up the fire hose. If this method returns successfully it should be safe to call hasMore() on the returned Firehose (which might subsequently block).

If this method returns null, then any attempt to call hasMore(), nextRow(), commit() and close() on the return value will throw a surprising NPE. Throwing IOException on connection failure or runtime exception on invalid configuration is preferred over returning null.

Specified by:

connect in interface FirehoseFactory<InputRowParser>

Throws:

IOException

getDelegateFactory

public FirehoseFactory getDelegateFactory()

isReportParseExceptions

public boolean isReportParseExceptions()

getMaxTempFileSize

public int getMaxTempFileSize()

getReadFirehoseRetries

public int getReadFirehoseRetries()

toString

public String toString()

Overrides:

toString in class Object