io.druid.storage.s3

Class S3TaskLogs

java.lang.Object

io.druid.storage.s3.S3TaskLogs

All Implemented Interfaces:

TaskLogKiller, TaskLogPusher, TaskLogs, TaskLogStreamer

public class S3TaskLogs
extends Object
implements TaskLogs

Provides task logs archived on S3.

Constructor Summary

Constructors

Constructor and Description
S3TaskLogs(S3TaskLogsConfig config, org.jets3t.service.impl.rest.httpclient.RestS3Service service)

Method Summary

Modifier and Type	Method and Description
void	killAll()
void	killOlderThan(long timestamp)
void	pushTaskLog(String taskid, File logFile)
com.google.common.base.Optional<com.google.common.io.ByteSource>	streamTaskLog(String taskid, long offset) Stream log for a task.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3TaskLogs

@Inject
public S3TaskLogs(S3TaskLogsConfig config,
                          org.jets3t.service.impl.rest.httpclient.RestS3Service service)

Method Detail

streamTaskLog

public com.google.common.base.Optional<com.google.common.io.ByteSource> streamTaskLog(String taskid,
                                                                                      long offset)
                                                                               throws IOException

Description copied from interface: TaskLogStreamer

Stream log for a task.

Specified by:

streamTaskLog in interface TaskLogStreamer

offset - If zero, stream the entire log. If positive, attempt to read from this position onwards. If negative, attempt to read this many bytes from the end of the file (like tail -n).

Returns:

input supplier for this log, if available from this provider

Throws:

IOException

pushTaskLog

public void pushTaskLog(String taskid,
                        File logFile)
                 throws IOException

Specified by:

pushTaskLog in interface TaskLogPusher

Throws:

IOException

killAll

public void killAll()
             throws IOException

Specified by:

killAll in interface TaskLogKiller

Throws:

IOException

killOlderThan

public void killOlderThan(long timestamp)
                   throws IOException

Specified by:

killOlderThan in interface TaskLogKiller

Throws:

IOException