io.druid.storage.s3

Class S3TimestampVersionedDataFinder

java.lang.Object

io.druid.storage.s3.S3DataSegmentPuller

io.druid.storage.s3.S3TimestampVersionedDataFinder

All Implemented Interfaces:

SearchableVersionedDataFinder<URI>, io.druid.segment.loading.DataSegmentPuller, io.druid.segment.loading.URIDataPuller

public class S3TimestampVersionedDataFinder
extends S3DataSegmentPuller
implements SearchableVersionedDataFinder<URI>

This is implemented explicitly for URIExtractionNamespaceFunctionFactory If you have a use case for this interface beyond URIExtractionNamespaceFunctionFactory please bring it up in the dev list.

Nested Class Summary

Nested classes/interfaces inherited from class io.druid.storage.s3.S3DataSegmentPuller

S3DataSegmentPuller.S3Coords

Field Summary

Fields inherited from class io.druid.storage.s3.S3DataSegmentPuller

BUCKET, DEFAULT_RETRY_COUNT, KEY, s3Client, scheme

Constructor Summary

Constructors

Constructor and Description
S3TimestampVersionedDataFinder(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client)

Method Summary

Methods

Modifier and Type	Method and Description
Class<URI>	getDataDescriptorClass()
URI	getLatestVersion(URI uri, Pattern pattern) Gets the latest version using the "parent" of uri as a prefix.

Methods inherited from class io.druid.storage.s3.S3DataSegmentPuller

buildFileObject, checkURI, getInputStream, getSegmentFiles, getSegmentFiles, getVersion, shouldRetryPredicate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3TimestampVersionedDataFinder

@Inject
public S3TimestampVersionedDataFinder(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client)

Method Detail

getLatestVersion

public URI getLatestVersion(URI uri,
                   Pattern pattern)

Gets the latest version using the "parent" of uri as a prefix. The "parent" of uri is evaluated assuming '/' delimited paths. If the uri path ends with '/', the path is assumed to be the parent.

Specified by:

getLatestVersion in interface SearchableVersionedDataFinder<URI>

Parameters:

uri - The URI of interest whose "parent" will be searched as a key prefix for the latest version

pattern - The pattern matcher to determine if a *key* is of interest. This will match against the entire key, not just the equivalent "filename" like some other implementations. A null value matches everything

Returns:

A URI to the most recently modified object which matched the pattern.

getDataDescriptorClass

public Class<URI> getDataDescriptorClass()

Specified by:

getDataDescriptorClass in interface SearchableVersionedDataFinder<URI>

Returns:

The class of the descriptor for the data