io.druid.indexing.common.task

Class ConvertSegmentTask

java.lang.Object

io.druid.indexing.common.task.AbstractTask

io.druid.indexing.common.task.AbstractFixedIntervalTask

io.druid.indexing.common.task.ConvertSegmentTask

All Implemented Interfaces:

Task

Direct Known Subclasses:

ConvertSegmentBackwardsCompatibleTask, HadoopConverterTask

public class ConvertSegmentTask
extends AbstractFixedIntervalTask

This task takes a segment and attempts to reindex it in the latest version with the specified indexSpec.

Only datasource must be specified. `indexSpec` and `force` are highly suggested but optional. The rest get auto-configured and should only be modified with great care

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ConvertSegmentTask.SubTask

Method Summary

Modifier and Type	Method and Description
static ConvertSegmentTask	create(DataSegment segment, IndexSpec indexSpec, boolean force, boolean validate, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory, Map<String,Object> context) Create a task to update the segment specified to the most recent binary version with the specified indexSpec
static ConvertSegmentTask	create(String dataSource, org.joda.time.Interval interval, IndexSpec indexSpec, boolean force, boolean validate, SegmentWriteOutMediumFactory segmentWriteOutMediumFactory, Map<String,Object> context) Create a segment converter task to convert a segment to the most recent version including the specified indexSpec
boolean	equals(Object o)
protected Iterable<Task>	generateSubTasks(String groupId, Iterable<DataSegment> segments, IndexSpec indexSpec, boolean force, boolean validate, Map<String,Object> context)
IndexSpec	getIndexSpec()
DataSegment	getSegment()
SegmentWriteOutMediumFactory	getSegmentWriteOutMediumFactory()
String	getType() Returns a descriptive label for this task type.
boolean	isForce()
boolean	isValidate()
protected static String	makeId(String dataSource, org.joda.time.Interval interval)
TaskStatus	run(TaskToolbox toolbox) Execute a task.

Methods inherited from class io.druid.indexing.common.task.AbstractFixedIntervalTask

getInterval, isReady

Methods inherited from class io.druid.indexing.common.task.AbstractTask

canRestore, getClasspathPrefix, getContext, getDataSource, getGroupId, getId, getNodeType, getQueryRunner, getTaskResource, hashCode, stopGracefully, success, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface io.druid.indexing.common.task.Task

getContextValue, getContextValue, getPriority

Method Detail

create

public static ConvertSegmentTask create(String dataSource,
                                        org.joda.time.Interval interval,
                                        IndexSpec indexSpec,
                                        boolean force,
                                        boolean validate,
                                        @Nullable
                                        SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
                                        Map<String,Object> context)

Create a segment converter task to convert a segment to the most recent version including the specified indexSpec

Parameters:

dataSource - The datasource to which this update should be applied

interval - The interval in the datasource which to apply the update to

indexSpec - The IndexSpec to use in the updated segments

force - Force an update, even if the task thinks it doesn't need to update.

validate - Validate the new segment compared to the old segment on a row by row basis

Returns:

A SegmentConverterTask for the datasource's interval with the indexSpec specified.

create

public static ConvertSegmentTask create(DataSegment segment,
                                        IndexSpec indexSpec,
                                        boolean force,
                                        boolean validate,
                                        @Nullable
                                        SegmentWriteOutMediumFactory segmentWriteOutMediumFactory,
                                        Map<String,Object> context)

Create a task to update the segment specified to the most recent binary version with the specified indexSpec

Parameters:

segment - The segment to which this update should be applied

indexSpec - The IndexSpec to use in the updated segments

force - Force an update, even if the task thinks it doesn't need to update.

validate - Validate the new segment compared to the old segment on a row by row basis

Returns:

A SegmentConverterTask for the segment with the indexSpec specified.

makeId

protected static String makeId(String dataSource,
                               org.joda.time.Interval interval)

isForce

public boolean isForce()

isValidate

public boolean isValidate()

getIndexSpec

public IndexSpec getIndexSpec()

getType

public String getType()

Description copied from interface: Task

Returns a descriptive label for this task type. Used for metrics emission and logging.

Returns:

task type label

getSegment

public DataSegment getSegment()

getSegmentWriteOutMediumFactory

@Nullable
public SegmentWriteOutMediumFactory getSegmentWriteOutMediumFactory()

run

public TaskStatus run(TaskToolbox toolbox)
               throws Exception

Description copied from interface: Task

Execute a task. This typically runs on a worker as determined by a TaskRunner, and will be run while holding a lock on our dataSource and implicit lock interval (if any). If this method throws an exception, the task should be considered a failure.

Parameters:

toolbox - Toolbox for this task

Returns:

Some kind of finished status (isRunnable must be false).

Throws:

Exception - if this task failed

generateSubTasks

protected Iterable<Task> generateSubTasks(String groupId,
                                          Iterable<DataSegment> segments,
                                          IndexSpec indexSpec,
                                          boolean force,
                                          boolean validate,
                                          Map<String,Object> context)

equals

public boolean equals(Object o)

Overrides:

equals in class AbstractTask