io.druid.indexer

Class HadoopIngestionSpec

java.lang.Object

io.druid.segment.indexing.IngestionSpec<HadoopIOConfig,HadoopTuningConfig>

io.druid.indexer.HadoopIngestionSpec

public class HadoopIngestionSpec
extends IngestionSpec<HadoopIOConfig,HadoopTuningConfig>

Constructor Summary

Constructors

Constructor and Description

HadoopIngestionSpec(DataSchema dataSchema, HadoopIOConfig ioConfig, HadoopTuningConfig tuningConfig, String dataSource, io.druid.data.input.impl.TimestampSpec timestampSpec, io.druid.data.input.impl.DataSpec dataSpec, GranularitySpec granularitySpec, Map<String,Object> pathSpec, String workingPath, String segmentOutputPath, String version, PartitionsSpec partitionsSpec, boolean leaveIntermediate, Boolean cleanupOnFailure, Map<org.joda.time.DateTime,List<HadoopyShardSpec>> shardSpecs, boolean overwriteFiles, DataRollupSpec rollupSpec, DbUpdaterJobSpec updaterJobSpec, boolean ignoreInvalidRows, Map<String,String> jobProperties, boolean combineText, String timestampColumn, String timestampFormat, List<org.joda.time.Interval> intervals, com.metamx.common.Granularity segmentGranularity, String partitionDimension, Long targetPartitionSize)

Method Summary

Methods

Modifier and Type	Method and Description
DataSchema	getDataSchema()
HadoopIOConfig	getIOConfig()
HadoopTuningConfig	getTuningConfig()
HadoopIngestionSpec	withDataSchema(DataSchema schema)
HadoopIngestionSpec	withIOConfig(HadoopIOConfig config)
HadoopIngestionSpec	withTuningConfig(HadoopTuningConfig config)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopIngestionSpec

public HadoopIngestionSpec(DataSchema dataSchema,
                   HadoopIOConfig ioConfig,
                   HadoopTuningConfig tuningConfig,
                   String dataSource,
                   io.druid.data.input.impl.TimestampSpec timestampSpec,
                   io.druid.data.input.impl.DataSpec dataSpec,
                   GranularitySpec granularitySpec,
                   Map<String,Object> pathSpec,
                   String workingPath,
                   String segmentOutputPath,
                   String version,
                   PartitionsSpec partitionsSpec,
                   boolean leaveIntermediate,
                   Boolean cleanupOnFailure,
                   Map<org.joda.time.DateTime,List<HadoopyShardSpec>> shardSpecs,
                   boolean overwriteFiles,
                   DataRollupSpec rollupSpec,
                   DbUpdaterJobSpec updaterJobSpec,
                   boolean ignoreInvalidRows,
                   Map<String,String> jobProperties,
                   boolean combineText,
                   String timestampColumn,
                   String timestampFormat,
                   List<org.joda.time.Interval> intervals,
                   com.metamx.common.Granularity segmentGranularity,
                   String partitionDimension,
                   Long targetPartitionSize)

Method Detail

getDataSchema

public DataSchema getDataSchema()

Overrides:

getDataSchema in class IngestionSpec<HadoopIOConfig,HadoopTuningConfig>

getIOConfig

public HadoopIOConfig getIOConfig()

Overrides:

getIOConfig in class IngestionSpec<HadoopIOConfig,HadoopTuningConfig>

getTuningConfig

public HadoopTuningConfig getTuningConfig()

Overrides:

getTuningConfig in class IngestionSpec<HadoopIOConfig,HadoopTuningConfig>

withDataSchema

public HadoopIngestionSpec withDataSchema(DataSchema schema)

withIOConfig

public HadoopIngestionSpec withIOConfig(HadoopIOConfig config)

withTuningConfig

public HadoopIngestionSpec withTuningConfig(HadoopTuningConfig config)