io.druid.storage.hdfs.tasklog

Class HdfsTaskLogs

java.lang.Object

io.druid.storage.hdfs.tasklog.HdfsTaskLogs

All Implemented Interfaces:

TaskLogKiller, TaskLogPusher, TaskLogs, TaskLogStreamer

public class HdfsTaskLogs
extends Object
implements TaskLogs

Indexer hdfs task logs, to support storing hdfs tasks to hdfs.

Constructor Summary

Constructors

Constructor and Description
HdfsTaskLogs(HdfsTaskLogsConfig config, org.apache.hadoop.conf.Configuration hadoopConfig)

Method Summary

Modifier and Type	Method and Description
void	killAll()
void	killOlderThan(long timestamp)
void	pushTaskLog(String taskId, File logFile)
com.google.common.base.Optional<com.google.common.io.ByteSource>	streamTaskLog(String taskId, long offset) Stream log for a task.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HdfsTaskLogs

@Inject
public HdfsTaskLogs(HdfsTaskLogsConfig config,
                            org.apache.hadoop.conf.Configuration hadoopConfig)

Method Detail

pushTaskLog

public void pushTaskLog(String taskId,
                        File logFile)
                 throws IOException

Specified by:

pushTaskLog in interface TaskLogPusher

Throws:

IOException

streamTaskLog

public com.google.common.base.Optional<com.google.common.io.ByteSource> streamTaskLog(String taskId,
                                                                                      long offset)
                                                                               throws IOException

Description copied from interface: TaskLogStreamer

Stream log for a task.

Specified by:

streamTaskLog in interface TaskLogStreamer

offset - If zero, stream the entire log. If positive, attempt to read from this position onwards. If negative, attempt to read this many bytes from the end of the file (like tail -n).

Returns:

input supplier for this log, if available from this provider

Throws:

IOException

killAll

public void killAll()
             throws IOException

Specified by:

killAll in interface TaskLogKiller

Throws:

IOException

killOlderThan

public void killOlderThan(long timestamp)
                   throws IOException

Specified by:

killOlderThan in interface TaskLogKiller

Throws:

IOException