Modifier and Type | Method and Description |
---|---|
IndexSpec |
HadoopTuningConfig.getIndexSpec() |
IndexSpec |
HadoopDruidIndexerConfig.getIndexSpec() |
Constructor and Description |
---|
HadoopTuningConfig(String workingPath,
String version,
PartitionsSpec partitionsSpec,
Map<Long,List<HadoopyShardSpec>> shardSpecs,
IndexSpec indexSpec,
Integer maxRowsInMemory,
boolean leaveIntermediate,
Boolean cleanupOnFailure,
boolean overwriteFiles,
boolean ignoreInvalidRows,
Map<String,String> jobProperties,
boolean combineText,
Boolean useCombiner,
Integer maxRowsInMemoryCOMPAT,
Boolean buildV9Directly,
Integer numBackgroundPersistThreads,
boolean forceExtendableShardSpecs,
boolean useExplicitVersion,
List<String> allowedHadoopPrefix) |
Modifier and Type | Method and Description |
---|---|
IndexSpec |
HadoopDruidConverterConfig.getIndexSpec() |
Constructor and Description |
---|
HadoopDruidConverterConfig(String dataSource,
org.joda.time.Interval interval,
IndexSpec indexSpec,
List<DataSegment> segments,
Boolean validate,
URI distributedSuccessCache,
Map<String,String> hadoopProperties,
String jobPriority,
String segmentOutputPath) |
Modifier and Type | Method and Description |
---|---|
IndexSpec |
SameIntervalMergeTask.getIndexSpec() |
IndexSpec |
MergeTask.getIndexSpec() |
IndexSpec |
IndexTask.IndexTuningConfig.getIndexSpec() |
IndexSpec |
ConvertSegmentTask.getIndexSpec() |
Modifier and Type | Method and Description |
---|---|
static ConvertSegmentTask |
ConvertSegmentTask.create(DataSegment segment,
IndexSpec indexSpec,
boolean force,
boolean validate,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context)
Create a task to update the segment specified to the most recent binary version with the specified indexSpec
|
static ConvertSegmentTask |
ConvertSegmentTask.create(String dataSource,
org.joda.time.Interval interval,
IndexSpec indexSpec,
boolean force,
boolean validate,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context)
Create a segment converter task to convert a segment to the most recent version including the specified indexSpec
|
protected Iterable<Task> |
HadoopConverterTask.generateSubTasks(String groupId,
Iterable<DataSegment> segments,
IndexSpec indexSpec,
boolean force,
boolean validate,
Map<String,Object> context) |
protected Iterable<Task> |
ConvertSegmentTask.generateSubTasks(String groupId,
Iterable<DataSegment> segments,
IndexSpec indexSpec,
boolean force,
boolean validate,
Map<String,Object> context) |
Constructor and Description |
---|
AppendTask(String id,
String dataSource,
List<DataSegment> segments,
List<AggregatorFactory> aggregators,
IndexSpec indexSpec,
Boolean buildV9Directly,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context) |
ConvertSegmentBackwardsCompatibleTask(String id,
String dataSource,
org.joda.time.Interval interval,
DataSegment segment,
IndexSpec indexSpec,
Boolean force,
Boolean validate,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
Deprecated.
|
HadoopConverterTask(String id,
String dataSource,
org.joda.time.Interval interval,
IndexSpec indexSpec,
boolean force,
Boolean validate,
List<String> hadoopDependencyCoordinates,
URI distributedSuccessCache,
String jobPriority,
String segmentOutputPath,
String classpathPrefix,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context) |
IndexTuningConfig(Integer targetPartitionSize,
Integer maxRowsInMemory,
Long maxTotalRows,
Integer rowFlushBoundary_forBackCompatibility,
Integer numShards,
IndexSpec indexSpec,
Integer maxPendingPersists,
Boolean buildV9Directly,
Boolean forceExtendableShardSpecs,
Boolean forceGuaranteedRollup,
Boolean reportParseExceptions,
Long publishTimeout,
Long pushTimeout,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
MergeTask(String id,
String dataSource,
List<DataSegment> segments,
List<AggregatorFactory> aggregators,
Boolean rollup,
IndexSpec indexSpec,
Boolean buildV9Directly,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context) |
SameIntervalMergeTask(String id,
String dataSource,
org.joda.time.Interval interval,
List<AggregatorFactory> aggregators,
Boolean rollup,
IndexSpec indexSpec,
Boolean buildV9Directly,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context) |
SubTask(String groupId,
DataSegment segment,
IndexSpec indexSpec,
Boolean force,
Boolean validate,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
Deprecated.
|
SubTask(String groupId,
DataSegment segment,
IndexSpec indexSpec,
Boolean force,
Boolean validate,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Map<String,Object> context) |
Modifier and Type | Method and Description |
---|---|
IndexSpec |
KafkaTuningConfig.getIndexSpec() |
Constructor and Description |
---|
KafkaTuningConfig(Integer maxRowsInMemory,
Integer maxRowsPerSegment,
org.joda.time.Period intermediatePersistPeriod,
File basePersistDirectory,
Integer maxPendingPersists,
IndexSpec indexSpec,
Boolean buildV9Directly,
Boolean reportParseExceptions,
Long handoffConditionTimeout,
Boolean resetOffsetAutomatically,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
Constructor and Description |
---|
KafkaSupervisorTuningConfig(Integer maxRowsInMemory,
Integer maxRowsPerSegment,
org.joda.time.Period intermediatePersistPeriod,
File basePersistDirectory,
Integer maxPendingPersists,
IndexSpec indexSpec,
Boolean buildV9Directly,
Boolean reportParseExceptions,
Long handoffConditionTimeout,
Boolean resetOffsetAutomatically,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
Integer workerThreads,
Integer chatThreads,
Long chatRetries,
org.joda.time.Period httpTimeout,
org.joda.time.Period shutdownTimeout,
org.joda.time.Period offsetFetchPeriod) |
Modifier and Type | Field and Description |
---|---|
protected IndexSpec |
LongDimensionMergerV9.indexSpec |
protected IndexSpec |
FloatDimensionMergerV9.indexSpec |
protected IndexSpec |
DoubleDimensionMergerV9.indexSpec |
Modifier and Type | Method and Description |
---|---|
File |
IndexMergerV9.append(List<IndexableAdapter> indexes,
AggregatorFactory[] aggregators,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.append(List<IndexableAdapter> indexes,
AggregatorFactory[] aggregators,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMergerV9.convert(File inDir,
File outDir,
IndexSpec indexSpec) |
File |
IndexMerger.convert(File inDir,
File outDir,
IndexSpec indexSpec) |
File |
IndexMergerV9.convert(File inDir,
File outDir,
IndexSpec indexSpec,
ProgressIndicator progress,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.convert(File inDir,
File outDir,
IndexSpec indexSpec,
ProgressIndicator progress,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
boolean |
IndexIO.convertSegment(File toConvert,
File converted,
IndexSpec indexSpec,
boolean forceIfCurrent,
boolean validate,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
DimensionMergerV9 |
StringDimensionHandler.makeMerger(IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium,
ColumnCapabilities capabilities,
ProgressIndicator progress) |
DimensionMergerV9<Long> |
LongDimensionHandler.makeMerger(IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium,
ColumnCapabilities capabilities,
ProgressIndicator progress) |
DimensionMergerV9<Float> |
FloatDimensionHandler.makeMerger(IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium,
ColumnCapabilities capabilities,
ProgressIndicator progress) |
DimensionMergerV9<Double> |
DoubleDimensionHandler.makeMerger(IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium,
ColumnCapabilities capabilities,
ProgressIndicator progress) |
DimensionMergerV9<EncodedKeyComponentType> |
DimensionHandler.makeMerger(IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium,
ColumnCapabilities capabilities,
ProgressIndicator progress)
Creates a new DimensionMergerV9, a per-dimension object responsible for merging indexes/row data across segments
and building the on-disk representation of a dimension.
|
File |
IndexMergerV9.merge(List<IndexableAdapter> indexes,
boolean rollup,
AggregatorFactory[] metricAggs,
File outDir,
IndexSpec indexSpec) |
File |
IndexMerger.merge(List<IndexableAdapter> indexes,
boolean rollup,
AggregatorFactory[] metricAggs,
File outDir,
IndexSpec indexSpec) |
File |
IndexMergerV9.mergeQueryableIndex(List<QueryableIndex> indexes,
boolean rollup,
AggregatorFactory[] metricAggs,
File outDir,
IndexSpec indexSpec,
ProgressIndicator progress,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.mergeQueryableIndex(List<QueryableIndex> indexes,
boolean rollup,
AggregatorFactory[] metricAggs,
File outDir,
IndexSpec indexSpec,
ProgressIndicator progress,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMergerV9.mergeQueryableIndex(List<QueryableIndex> indexes,
boolean rollup,
AggregatorFactory[] metricAggs,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.mergeQueryableIndex(List<QueryableIndex> indexes,
boolean rollup,
AggregatorFactory[] metricAggs,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMergerV9.persist(IncrementalIndex index,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.persist(IncrementalIndex index,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMergerV9.persist(IncrementalIndex index,
org.joda.time.Interval dataInterval,
File outDir,
IndexSpec indexSpec,
ProgressIndicator progress,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.persist(IncrementalIndex index,
org.joda.time.Interval dataInterval,
File outDir,
IndexSpec indexSpec,
ProgressIndicator progress,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMergerV9.persist(IncrementalIndex index,
org.joda.time.Interval dataInterval,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
File |
IndexMerger.persist(IncrementalIndex index,
org.joda.time.Interval dataInterval,
File outDir,
IndexSpec indexSpec,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory)
This is *not* thread-safe and havok will ensue if this is called and writes are still occurring
on the IncrementalIndex object.
|
Constructor and Description |
---|
DoubleDimensionMergerV9(String dimensionName,
IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium) |
FloatDimensionMergerV9(String dimensionName,
IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium) |
StringDimensionMergerV9(String dimensionName,
IndexSpec indexSpec,
SegmentWriteOutMedium segmentWriteOutMedium,
ColumnCapabilities capabilities,
ProgressIndicator progress) |
Modifier and Type | Method and Description |
---|---|
IndexSpec |
RealtimeTuningConfig.getIndexSpec() |
Constructor and Description |
---|
RealtimeTuningConfig(Integer maxRowsInMemory,
org.joda.time.Period intermediatePersistPeriod,
org.joda.time.Period windowPeriod,
File basePersistDirectory,
VersioningPolicy versioningPolicy,
RejectionPolicyFactory rejectionPolicyFactory,
Integer maxPendingPersists,
ShardSpec shardSpec,
IndexSpec indexSpec,
Boolean buildV9Directly,
int persistThreadPriority,
int mergeThreadPriority,
Boolean reportParseExceptions,
Long handoffConditionTimeout,
Long alertTimeout,
SegmentWriteOutMediumFactory segmentWriteOutMediumFactory) |
Modifier and Type | Method and Description |
---|---|
IndexSpec |
AppenderatorConfig.getIndexSpec() |
Copyright © 2011–2018. All rights reserved.