io.druid.segment.loading

Class LocalDataSegmentPuller

java.lang.Object

io.druid.segment.loading.LocalDataSegmentPuller

All Implemented Interfaces:

DataSegmentPuller, URIDataPuller

Direct Known Subclasses:

LocalFileTimestampVersionFinder

public class LocalDataSegmentPuller
extends Object
implements DataSegmentPuller, URIDataPuller

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_RETRY_COUNT

Constructor Summary

Constructors

Constructor and Description
LocalDataSegmentPuller()

Method Summary

Modifier and Type	Method and Description
static FileObject	buildFileObject(URI uri)
InputStream	getInputStream(URI uri) Create a new InputStream based on the URI
void	getSegmentFiles(DataSegment segment, File dir) Pull down segment files for the given DataSegment and put them in the given directory.
FileUtils.FileCopyResult	getSegmentFiles(File sourceFile, File dir)
String	getVersion(URI uri) Returns the "version" (aka last modified timestamp) of the URI of interest
com.google.common.base.Predicate<Throwable>	shouldRetryPredicate() Evaluates a Throwable to see if it is recoverable.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_RETRY_COUNT

public static final int DEFAULT_RETRY_COUNT

See Also:

Constant Field Values

Constructor Detail

LocalDataSegmentPuller

public LocalDataSegmentPuller()

Method Detail

buildFileObject

public static FileObject buildFileObject(URI uri)

getSegmentFiles

public void getSegmentFiles(DataSegment segment,
                            File dir)
                     throws SegmentLoadingException

Description copied from interface: DataSegmentPuller

Pull down segment files for the given DataSegment and put them in the given directory.

Specified by:

getSegmentFiles in interface DataSegmentPuller

Parameters:

segment - The segment to pull down files for

dir - The directory to store the files in

Throws:

SegmentLoadingException - if there are any errors

getSegmentFiles

public FileUtils.FileCopyResult getSegmentFiles(File sourceFile,
                                                File dir)
                                         throws SegmentLoadingException

Throws:

SegmentLoadingException

getInputStream

public InputStream getInputStream(URI uri)
                           throws IOException

Description copied from interface: URIDataPuller

Create a new InputStream based on the URI

Specified by:

getInputStream in interface URIDataPuller

Parameters:

uri - The URI to open an Input Stream to

Returns:

A new InputStream which streams the URI in question

Throws:

IOException

getVersion

public String getVersion(URI uri)

Returns the "version" (aka last modified timestamp) of the URI of interest

Specified by:

getVersion in interface URIDataPuller

Parameters:

uri - The URI to check the last modified timestamp

Returns:

The last modified timestamp in ms of the URI in String format

shouldRetryPredicate

public com.google.common.base.Predicate<Throwable> shouldRetryPredicate()

Description copied from interface: URIDataPuller

Evaluates a Throwable to see if it is recoverable. This is expected to be used in conjunction with the other methods to determine if anything thrown from the method should be retried.

Specified by:

shouldRetryPredicate in interface URIDataPuller

Returns:

Predicate function indicating if the Throwable is recoverable