public class StaticS3FirehoseFactory extends PrefetchableTextFilesFirehoseFactory<org.jets3t.service.model.S3Object>
Constructor and Description |
---|
StaticS3FirehoseFactory(org.jets3t.service.impl.rest.httpclient.RestS3Service s3Client,
List<URI> uris,
List<URI> prefixes,
Long maxCacheCapacityBytes,
Long maxFetchCapacityBytes,
Long prefetchTriggerBytes,
Long fetchTimeout,
Integer maxFetchRetry) |
Modifier and Type | Method and Description |
---|---|
boolean |
equals(Object o) |
List<URI> |
getPrefixes() |
List<URI> |
getUris() |
int |
hashCode() |
protected Collection<org.jets3t.service.model.S3Object> |
initObjects()
Initialize objects to be read by this firehose.
|
protected InputStream |
openObjectStream(org.jets3t.service.model.S3Object object)
Open an input stream from the given object.
|
protected InputStream |
wrapObjectStream(org.jets3t.service.model.S3Object object,
InputStream stream)
Wrap the given input stream if needed.
|
connect, getFetchTimeout, getMaxCacheCapacityBytes, getMaxFetchCapacityBytes, getMaxFetchRetry, getPrefetchTriggerBytes
clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait
connect
protected Collection<org.jets3t.service.model.S3Object> initObjects() throws IOException
AbstractTextFilesFirehoseFactory
AbstractTextFilesFirehoseFactory.connect(StringInputRowParser, File)
is called.initObjects
in class AbstractTextFilesFirehoseFactory<org.jets3t.service.model.S3Object>
IOException
protected InputStream openObjectStream(org.jets3t.service.model.S3Object object) throws IOException
AbstractTextFilesFirehoseFactory
AbstractTextFilesFirehoseFactory.wrapObjectStream(Object, InputStream)
.openObjectStream
in class AbstractTextFilesFirehoseFactory<org.jets3t.service.model.S3Object>
object
- an object to be readIOException
protected InputStream wrapObjectStream(org.jets3t.service.model.S3Object object, InputStream stream) throws IOException
AbstractTextFilesFirehoseFactory
wrapObjectStream
in class AbstractTextFilesFirehoseFactory<org.jets3t.service.model.S3Object>
object
- an input objectstream
- a stream for the objectIOException
Copyright © 2011–2018. All rights reserved.