io.druid.indexing.common.task

Class ConvertSegmentTask

java.lang.Object

io.druid.indexing.common.task.AbstractTask

io.druid.indexing.common.task.AbstractFixedIntervalTask

io.druid.indexing.common.task.ConvertSegmentTask

All Implemented Interfaces:

Task

Direct Known Subclasses:

ConvertSegmentBackwardsCompatibleTask, HadoopConverterTask

public class ConvertSegmentTask
extends AbstractFixedIntervalTask

This task takes a segment and attempts to reindex it in the latest version with the specified indexSpec.

Only datasource must be specified. `indexSpec` and `force` are highly suggested but optional. The rest get auto-configured and should only be modified with great care

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ConvertSegmentTask.SubTask

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	ConvertSegmentTask(String id, String dataSource, org.joda.time.Interval interval, DataSegment segment, IndexSpec indexSpec, boolean force, boolean validate, Map<String,Object> context)

Method Summary

Modifier and Type	Method and Description
static ConvertSegmentTask	create(DataSegment segment, IndexSpec indexSpec, boolean force, boolean validate, Map<String,Object> context) Create a task to update the segment specified to the most recent binary version with the specified indexSpec
static ConvertSegmentTask	create(String dataSource, org.joda.time.Interval interval, IndexSpec indexSpec, boolean force, boolean validate, Map<String,Object> context) Create a segment converter task to convert a segment to the most recent version including the specified indexSpec
boolean	equals(Object o)
protected Iterable<Task>	generateSubTasks(String groupId, Iterable<DataSegment> segments, IndexSpec indexSpec, boolean force, boolean validate, Map<String,Object> context)
IndexSpec	getIndexSpec()
DataSegment	getSegment()
String	getType() Returns a descriptive label for this task type.
boolean	isForce()
boolean	isValidate()
protected static String	makeId(String dataSource, org.joda.time.Interval interval)
TaskStatus	run(TaskToolbox toolbox) Execute a task.

Methods inherited from class io.druid.indexing.common.task.AbstractFixedIntervalTask

getInterval, isReady

Methods inherited from class io.druid.indexing.common.task.AbstractTask

canRestore, getClasspathPrefix, getContext, getContextValue, getDataSource, getGroupId, getId, getNodeType, getQueryRunner, getTaskLocks, getTaskResource, hashCode, joinId, makeId, stopGracefully, success, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ConvertSegmentTask

protected ConvertSegmentTask(String id,
                             String dataSource,
                             org.joda.time.Interval interval,
                             DataSegment segment,
                             IndexSpec indexSpec,
                             boolean force,
                             boolean validate,
                             Map<String,Object> context)

Method Detail

create

public static ConvertSegmentTask create(String dataSource,
                                        org.joda.time.Interval interval,
                                        IndexSpec indexSpec,
                                        boolean force,
                                        boolean validate,
                                        Map<String,Object> context)

Create a segment converter task to convert a segment to the most recent version including the specified indexSpec

Parameters:

dataSource - The datasource to which this update should be applied

interval - The interval in the datasource which to apply the update to

indexSpec - The IndexSpec to use in the updated segments

force - Force an update, even if the task thinks it doesn't need to update.

validate - Validate the new segment compared to the old segment on a row by row basis

Returns:

A SegmentConverterTask for the datasource's interval with the indexSpec specified.

create

public static ConvertSegmentTask create(DataSegment segment,
                                        IndexSpec indexSpec,
                                        boolean force,
                                        boolean validate,
                                        Map<String,Object> context)

Create a task to update the segment specified to the most recent binary version with the specified indexSpec

Parameters:

segment - The segment to which this update should be applied

indexSpec - The IndexSpec to use in the updated segments

force - Force an update, even if the task thinks it doesn't need to update.

validate - Validate the new segment compared to the old segment on a row by row basis

Returns:

A SegmentConverterTask for the segment with the indexSpec specified.

makeId

protected static String makeId(String dataSource,
                               org.joda.time.Interval interval)

isForce

public boolean isForce()

isValidate

public boolean isValidate()

getIndexSpec

public IndexSpec getIndexSpec()

getType

public String getType()

Description copied from interface: Task

Returns a descriptive label for this task type. Used for metrics emission and logging.

Returns:

task type label

getSegment

public DataSegment getSegment()

run

public TaskStatus run(TaskToolbox toolbox)
               throws Exception

Description copied from interface: Task

Execute a task. This typically runs on a worker as determined by a TaskRunner, and will be run while holding a lock on our dataSource and implicit lock interval (if any). If this method throws an exception, the task should be considered a failure.

Parameters:

toolbox - Toolbox for this task

Returns:

Some kind of finished status (isRunnable must be false).

Throws:

Exception - if this task failed

generateSubTasks

protected Iterable<Task> generateSubTasks(String groupId,
                                          Iterable<DataSegment> segments,
                                          IndexSpec indexSpec,
                                          boolean force,
                                          boolean validate,
                                          Map<String,Object> context)

equals

public boolean equals(Object o)

Overrides:

equals in class AbstractTask