io.druid.indexing.overlord

Class ForkingTaskRunner

java.lang.Object

io.druid.indexing.overlord.ForkingTaskRunner

All Implemented Interfaces:

TaskRunner, io.druid.tasklogs.TaskLogStreamer

public class ForkingTaskRunner
extends Object
implements TaskRunner, io.druid.tasklogs.TaskLogStreamer

Runs tasks in separate processes using the "internal peon" verb.

Constructor Summary

Constructors

Constructor and Description
ForkingTaskRunner(ForkingTaskRunnerConfig config, TaskConfig taskConfig, WorkerConfig workerConfig, Properties props, io.druid.tasklogs.TaskLogPusher taskLogPusher, com.fasterxml.jackson.databind.ObjectMapper jsonMapper, DruidNode node)

Method Summary

Modifier and Type	Method and Description
Collection<TaskRunnerWorkItem>	getKnownTasks()
Collection<TaskRunnerWorkItem>	getPendingTasks()
Collection<TaskRunnerWorkItem>	getRunningTasks()
com.google.common.base.Optional<ScalingStats>	getScalingStats() Some runners are able to scale up and down their capacity in a dynamic manner.
List<com.metamx.common.Pair<Task,com.google.common.util.concurrent.ListenableFuture<TaskStatus>>>	restore() Some task runners can restart previously-running tasks after being bounced.
com.google.common.util.concurrent.ListenableFuture<TaskStatus>	run(Task task) Run a task.
void	shutdown(String taskid) Inform the task runner it can clean up any resources associated with a task.
void	stop() Stop this task runner.
com.google.common.base.Optional<com.google.common.io.ByteSource>	streamTaskLog(String taskid, long offset)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ForkingTaskRunner

@Inject
public ForkingTaskRunner(ForkingTaskRunnerConfig config,
                                 TaskConfig taskConfig,
                                 WorkerConfig workerConfig,
                                 Properties props,
                                 io.druid.tasklogs.TaskLogPusher taskLogPusher,
                                 com.fasterxml.jackson.databind.ObjectMapper jsonMapper,
                                 DruidNode node)

Method Detail

restore

public List<com.metamx.common.Pair<Task,com.google.common.util.concurrent.ListenableFuture<TaskStatus>>> restore()

Description copied from interface: TaskRunner

Some task runners can restart previously-running tasks after being bounced. This method does that, and returns the list of tasks (and status futures).

Specified by:

restore in interface TaskRunner

run

public com.google.common.util.concurrent.ListenableFuture<TaskStatus> run(Task task)

Description copied from interface: TaskRunner

Run a task. The returned status should be some kind of completed status.

Specified by:

run in interface TaskRunner

Parameters:

task - task to run

Returns:

task status, eventually

stop

public void stop()

Description copied from interface: TaskRunner

Stop this task runner. This may block until currently-running tasks can be gracefully stopped. After calling stopping, "run" will not accept further tasks.

Specified by:

stop in interface TaskRunner

shutdown

public void shutdown(String taskid)

Description copied from interface: TaskRunner

Inform the task runner it can clean up any resources associated with a task. This implies shutdown of any currently-running tasks.

Specified by:

shutdown in interface TaskRunner

Parameters:

taskid - task ID to clean up resources for

getRunningTasks

public Collection<TaskRunnerWorkItem> getRunningTasks()

Specified by:

getRunningTasks in interface TaskRunner

getPendingTasks

public Collection<TaskRunnerWorkItem> getPendingTasks()

Specified by:

getPendingTasks in interface TaskRunner

getKnownTasks

public Collection<TaskRunnerWorkItem> getKnownTasks()

Specified by:

getKnownTasks in interface TaskRunner

getScalingStats

public com.google.common.base.Optional<ScalingStats> getScalingStats()

Description copied from interface: TaskRunner

Some runners are able to scale up and down their capacity in a dynamic manner. This returns stats on those activities

Specified by:

getScalingStats in interface TaskRunner

Returns:

ScalingStats if the runner has an underlying resource which can scale, Optional.absent() otherwise

streamTaskLog

public com.google.common.base.Optional<com.google.common.io.ByteSource> streamTaskLog(String taskid,
                                                                                      long offset)

Specified by:

streamTaskLog in interface io.druid.tasklogs.TaskLogStreamer