Modifier and Type | Method and Description |
---|---|
Map<DataSegment,File> |
TaskToolbox.fetchSegments(List<DataSegment> segments) |
Modifier and Type | Method and Description |
---|---|
DataSegment |
DataSegmentArchiver.archive(DataSegment segment)
Perform an archive task on the segment and return the resulting segment or null if there was no action needed.
|
DataSegment |
OmniDataSegmentArchiver.archive(DataSegment segment) |
void |
SegmentLoaderLocalCacheManager.cleanup(DataSegment segment) |
void |
SegmentLoader.cleanup(DataSegment segment) |
Segment |
SegmentizerFactory.factorize(DataSegment segment,
File parentDir) |
Segment |
MMappedQueryableSegmentizerFactory.factorize(DataSegment dataSegment,
File parentDir) |
Set<DataSegment> |
DataSegmentFinder.findSegments(String workingDirPath,
boolean updateDescriptor)
This method should first recursively look for descriptor.json (partitionNum_descriptor.json for HDFS data storage) underneath
workingDirPath and then verify that index.zip (partitionNum_index.zip for HDFS data storage) exists in the same folder.
|
Set<DataSegment> |
LocalDataSegmentFinder.findSegments(String workingDirPath,
boolean updateDescriptor) |
Segment |
SegmentLoaderLocalCacheManager.getSegment(DataSegment segment) |
Segment |
SegmentLoader.getSegment(DataSegment segment) |
File |
SegmentLoaderLocalCacheManager.getSegmentFiles(DataSegment segment) |
File |
SegmentLoader.getSegmentFiles(DataSegment segment) |
void |
DataSegmentPuller.getSegmentFiles(DataSegment segment,
File dir)
Pull down segment files for the given DataSegment and put them in the given directory.
|
void |
LocalDataSegmentPuller.getSegmentFiles(DataSegment segment,
File dir) |
FileUtils.FileCopyResult |
LocalDataSegmentPuller.getSegmentFiles(File sourceFile,
File dir) |
boolean |
SegmentLoader.isSegmentLoaded(DataSegment segment) |
void |
DataSegmentKiller.kill(DataSegment segments) |
void |
OmniDataSegmentKiller.kill(DataSegment segment) |
void |
LocalDataSegmentKiller.kill(DataSegment segment) |
LoadSpec.LoadSpecResult |
LoadSpec.loadSegment(File destDir)
Method should put the segment files in the directory passed
|
LoadSpec.LoadSpecResult |
LocalLoadSpec.loadSegment(File outDir) |
DataSegment |
DataSegmentMover.move(DataSegment segment,
Map<String,Object> targetLoadSpec) |
DataSegment |
OmniDataSegmentMover.move(DataSegment segment,
Map<String,Object> targetLoadSpec) |
DataSegment |
DataSegmentArchiver.restore(DataSegment segment)
Perform the restore from an archived segment and return the resulting segment or null if there was no action
|
DataSegment |
OmniDataSegmentArchiver.restore(DataSegment segment) |
Modifier and Type | Method and Description |
---|---|
void |
ServerManager.dropSegment(DataSegment segment) |
boolean |
ServerManager.isSegmentCached(DataSegment segment) |
boolean |
ServerManager.loadSegment(DataSegment segment)
Load a single segment.
|
Modifier and Type | Method and Description |
---|---|
void |
AzureDataSegmentPuller.getSegmentFiles(DataSegment segment,
File outDir) |
FileUtils.FileCopyResult |
AzureDataSegmentPuller.getSegmentFiles(String containerName,
String blobPath,
File outDir) |
void |
AzureDataSegmentKiller.kill(DataSegment segment) |
LoadSpec.LoadSpecResult |
AzureLoadSpec.loadSegment(File file) |
Modifier and Type | Method and Description |
---|---|
void |
CassandraDataSegmentPuller.getSegmentFiles(DataSegment segment,
File outDir) |
FileUtils.FileCopyResult |
CassandraDataSegmentPuller.getSegmentFiles(String key,
File outDir) |
LoadSpec.LoadSpecResult |
CassandraLoadSpec.loadSegment(File outDir) |
Modifier and Type | Method and Description |
---|---|
void |
CloudFilesDataSegmentPuller.getSegmentFiles(DataSegment segment,
File outDir) |
FileUtils.FileCopyResult |
CloudFilesDataSegmentPuller.getSegmentFiles(String region,
String container,
String path,
File outDir) |
LoadSpec.LoadSpecResult |
CloudFilesLoadSpec.loadSegment(File file) |
Modifier and Type | Method and Description |
---|---|
void |
GoogleDataSegmentPuller.getSegmentFiles(DataSegment segment,
File outDir) |
FileUtils.FileCopyResult |
GoogleDataSegmentPuller.getSegmentFiles(String bucket,
String path,
File outDir) |
void |
GoogleDataSegmentKiller.kill(DataSegment segment) |
LoadSpec.LoadSpecResult |
GoogleLoadSpec.loadSegment(File file) |
Modifier and Type | Method and Description |
---|---|
Set<DataSegment> |
HdfsDataSegmentFinder.findSegments(String workingDirPathStr,
boolean updateDescriptor) |
void |
HdfsDataSegmentPuller.getSegmentFiles(DataSegment segment,
File dir) |
FileUtils.FileCopyResult |
HdfsDataSegmentPuller.getSegmentFiles(org.apache.hadoop.fs.Path path,
File outDir) |
FileUtils.FileCopyResult |
HdfsDataSegmentPuller.getSegmentFiles(URI uri,
File outDir) |
void |
HdfsDataSegmentKiller.kill(DataSegment segment) |
LoadSpec.LoadSpecResult |
HdfsLoadSpec.loadSegment(File outDir) |
Modifier and Type | Method and Description |
---|---|
DataSegment |
S3DataSegmentArchiver.archive(DataSegment segment) |
Set<DataSegment> |
S3DataSegmentFinder.findSegments(String workingDirPath,
boolean updateDescriptor) |
void |
S3DataSegmentPuller.getSegmentFiles(DataSegment segment,
File outDir) |
FileUtils.FileCopyResult |
S3DataSegmentPuller.getSegmentFiles(S3DataSegmentPuller.S3Coords s3Coords,
File outDir) |
void |
S3DataSegmentKiller.kill(DataSegment segment) |
LoadSpec.LoadSpecResult |
S3LoadSpec.loadSegment(File outDir) |
DataSegment |
S3DataSegmentMover.move(DataSegment segment,
Map<String,Object> targetLoadSpec) |
DataSegment |
S3DataSegmentArchiver.restore(DataSegment segment) |
Copyright © 2011–2017. All rights reserved.