io.druid.storage.s3

Class S3TimestampVersionedDataFinder

java.lang.Object

io.druid.storage.s3.S3DataSegmentPuller

io.druid.storage.s3.S3TimestampVersionedDataFinder

All Implemented Interfaces:

SearchableVersionedDataFinder<URI>, DataSegmentPuller, URIDataPuller

public class S3TimestampVersionedDataFinder
extends S3DataSegmentPuller
implements SearchableVersionedDataFinder<URI>

This is implemented explicitly for URIExtractionNamespaceFunctionFactory If you have a use case for this interface beyond URIExtractionNamespaceFunctionFactory please bring it up in the dev list.

Nested Class Summary

Nested classes/interfaces inherited from class io.druid.storage.s3.S3DataSegmentPuller

S3DataSegmentPuller.S3Coords

Field Summary

Fields inherited from class io.druid.storage.s3.S3DataSegmentPuller

BUCKET, DEFAULT_RETRY_COUNT, KEY, s3Client, scheme

Constructor Summary

Constructors

Constructor and Description
S3TimestampVersionedDataFinder(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client)

Method Summary

Modifier and Type	Method and Description
URI	getLatestVersion(URI uri, Pattern pattern) Gets the key with the most recently modified timestamp.

Methods inherited from class io.druid.storage.s3.S3DataSegmentPuller

buildFileObject, checkURI, getInputStream, getSegmentFiles, getSegmentFiles, getVersion, shouldRetryPredicate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3TimestampVersionedDataFinder

@Inject
public S3TimestampVersionedDataFinder(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client)

Method Detail

getLatestVersion

public URI getLatestVersion(URI uri,
                            @Nullable
                            Pattern pattern)

Gets the key with the most recently modified timestamp. `pattern` is evaluated against the entire key AFTER the path given in `uri`. The substring `pattern` is matched against will have a leading `/` removed. For example `s3://some_bucket/some_prefix/some_key` with a URI of `s3://some_bucket/some_prefix` will match against `some_key`. `s3://some_bucket/some_prefixsome_key` with a URI of `s3://some_bucket/some_prefix` will match against `some_key` `s3://some_bucket/some_prefix//some_key` with a URI of `s3://some_bucket/some_prefix` will match against `/some_key`

Specified by:

getLatestVersion in interface SearchableVersionedDataFinder<URI>

Parameters:

uri - The URI of in the form of `s3://some_bucket/some_key`

pattern - The pattern matcher to determine if a *key* is of interest, or `null` to match everything.

Returns:

A URI to the most recently modified object which matched the pattern.