io.druid.storage.s3

Class S3Utils

java.lang.Object

io.druid.storage.s3.S3Utils

public class S3Utils
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
static com.google.common.base.Predicate<Throwable>	S3RETRY

Constructor Summary

Constructors

Constructor and Description
S3Utils()

Method Summary

Methods

Modifier and Type	Method and Description
static void	closeStreamsQuietly(org.jets3t.service.model.S3Object s3Obj)
static String	constructSegmentPath(String baseKey, io.druid.timeline.DataSegment segment)
static String	descriptorPathForSegmentPath(String s3Path)
static boolean	isObjectInBucket(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client, String bucketName, String objectKey)
static boolean	isServiceExceptionRecoverable(org.jets3t.service.ServiceException ex)
static <T> T	retryS3Operation(Callable<T> f) Retries S3 operations that fail due to io-related exceptions.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

S3RETRY

public static final com.google.common.base.Predicate<Throwable> S3RETRY

Constructor Detail

S3Utils

public S3Utils()

Method Detail

closeStreamsQuietly

public static void closeStreamsQuietly(org.jets3t.service.model.S3Object s3Obj)

isServiceExceptionRecoverable

public static boolean isServiceExceptionRecoverable(org.jets3t.service.ServiceException ex)

retryS3Operation

public static <T> T retryS3Operation(Callable<T> f)
                          throws Exception

Retries S3 operations that fail due to io-related exceptions. Service-level exceptions (access denied, file not found, etc) are not retried.

Throws:

Exception

isObjectInBucket

public static boolean isObjectInBucket(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client,
                       String bucketName,
                       String objectKey)
                                throws org.jets3t.service.ServiceException

Throws:

org.jets3t.service.ServiceException

constructSegmentPath

public static String constructSegmentPath(String baseKey,
                          io.druid.timeline.DataSegment segment)

descriptorPathForSegmentPath

public static String descriptorPathForSegmentPath(String s3Path)