io.druid.storage.s3

Class S3DataSegmentPusher

java.lang.Object

io.druid.storage.s3.S3DataSegmentPusher

All Implemented Interfaces:

DataSegmentPusher

public class S3DataSegmentPusher
extends Object
implements DataSegmentPusher

Field Summary

Fields inherited from interface io.druid.segment.loading.DataSegmentPusher

JOINER

Constructor Summary

Constructors

Constructor and Description
S3DataSegmentPusher(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client, S3DataSegmentPusherConfig config, com.fasterxml.jackson.databind.ObjectMapper jsonMapper)

Method Summary

Modifier and Type	Method and Description
List<String>	getAllowedPropertyPrefixesForHadoop() Property prefixes that should be added to the "allowedHadoopPrefix" config for passing down to Hadoop jobs.
String	getPathForHadoop()
String	getPathForHadoop(String dataSource) Deprecated.
Map<String,Object>	makeLoadSpec(URI finalIndexZipFilePath)
DataSegment	push(File indexFilesDir, DataSegment inSegment)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.druid.segment.loading.DataSegmentPusher

getDefaultStorageDir, getStorageDir, makeIndexPathName

Constructor Detail

S3DataSegmentPusher

@Inject
public S3DataSegmentPusher(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client,
                                   S3DataSegmentPusherConfig config,
                                   com.fasterxml.jackson.databind.ObjectMapper jsonMapper)

Method Detail

getPathForHadoop

public String getPathForHadoop()

Specified by:

getPathForHadoop in interface DataSegmentPusher

getPathForHadoop

@Deprecated
public String getPathForHadoop(String dataSource)

Deprecated.

Specified by:

getPathForHadoop in interface DataSegmentPusher

getAllowedPropertyPrefixesForHadoop

public List<String> getAllowedPropertyPrefixesForHadoop()

Description copied from interface: DataSegmentPusher

Property prefixes that should be added to the "allowedHadoopPrefix" config for passing down to Hadoop jobs. These should be property prefixes like "druid.xxx", which means to include "druid.xxx" and "druid.xxx.*".

Specified by:

getAllowedPropertyPrefixesForHadoop in interface DataSegmentPusher

push

public DataSegment push(File indexFilesDir,
                        DataSegment inSegment)
                 throws IOException

Specified by:

push in interface DataSegmentPusher

Throws:

IOException

makeLoadSpec

public Map<String,Object> makeLoadSpec(URI finalIndexZipFilePath)

Specified by:

makeLoadSpec in interface DataSegmentPusher