public class FireDepartment extends IngestionSpec<RealtimeIOConfig,RealtimeTuningConfig>
This is a metaphor for a realtime stream (Firehose) and a coordinator of sinks (Plumber). The Firehose provides the realtime stream of data. The Plumber directs each drop of water from the firehose into the correct sink and makes sure that the sinks don't overflow.
Constructor and Description |
---|
FireDepartment(DataSchema dataSchema,
RealtimeIOConfig ioConfig,
RealtimeTuningConfig tuningConfig) |
Modifier and Type | Method and Description |
---|---|
boolean |
checkFirehoseV2() |
Firehose |
connect() |
FirehoseV2 |
connect(Object metaData) |
Plumber |
findPlumber() |
DataSchema |
getDataSchema()
Provides the data schema for the feed that this FireDepartment is in charge of.
|
RealtimeIOConfig |
getIOConfig() |
FireDepartmentMetrics |
getMetrics() |
RealtimeTuningConfig |
getTuningConfig() |
public FireDepartment(DataSchema dataSchema, RealtimeIOConfig ioConfig, RealtimeTuningConfig tuningConfig)
public DataSchema getDataSchema()
getDataSchema
in class IngestionSpec<RealtimeIOConfig,RealtimeTuningConfig>
public RealtimeIOConfig getIOConfig()
getIOConfig
in class IngestionSpec<RealtimeIOConfig,RealtimeTuningConfig>
public RealtimeTuningConfig getTuningConfig()
getTuningConfig
in class IngestionSpec<RealtimeIOConfig,RealtimeTuningConfig>
public Plumber findPlumber()
public boolean checkFirehoseV2()
public Firehose connect() throws IOException
IOException
public FirehoseV2 connect(Object metaData) throws IOException
IOException
public FireDepartmentMetrics getMetrics()
Copyright © 2011–2017. All rights reserved.