io.druid.server.namespace

Class KafkaExtractionNamespaceFactory

java.lang.Object

io.druid.server.namespace.KafkaExtractionNamespaceFactory

All Implemented Interfaces:

ExtractionNamespaceFunctionFactory<KafkaExtractionNamespace>

public class KafkaExtractionNamespaceFactory
extends Object
implements ExtractionNamespaceFunctionFactory<KafkaExtractionNamespace>

Constructor Summary

Constructors

Constructor and Description
KafkaExtractionNamespaceFactory(KafkaExtractionManager kafkaExtractionManager)

Method Summary

Modifier and Type	Method and Description
com.google.common.base.Function<String,String>	buildFn(KafkaExtractionNamespace extractionNamespace, Map<String,String> cache) Create a function for the given namespace which will do the manipulation requested in the extractionNamespace.
com.google.common.base.Function<String,List<String>>	buildReverseFn(KafkaExtractionNamespace extractionNamespace, Map<String,String> cache)
Callable<String>	getCachePopulator(KafkaExtractionNamespace extractionNamespace, String unused, Map<String,String> cache) This function is called once if `ExtractionNamespace.getUpdateMs() == 0`, or every update if `ExtractionNamespace.getUpdateMs() > 0` For ExtractionNamespace which have the NamespaceExtractionCacheManager handle regular updates, this function is used to populate the namespace cache each time.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaExtractionNamespaceFactory

@Inject
public KafkaExtractionNamespaceFactory(KafkaExtractionManager kafkaExtractionManager)

Method Detail

buildFn

public com.google.common.base.Function<String,String> buildFn(KafkaExtractionNamespace extractionNamespace,
                                                              Map<String,String> cache)

Description copied from interface: ExtractionNamespaceFunctionFactory

Create a function for the given namespace which will do the manipulation requested in the extractionNamespace. A simple implementation would simply use the cache supplied by the `NamespaceExtractionCacheManager`. More advanced implementations may need more than just what can be cached by `NamespaceExtractionCacheManager`.

Specified by:

buildFn in interface ExtractionNamespaceFunctionFactory<KafkaExtractionNamespace>

Parameters:

extractionNamespace - The ExtractionNamespace for which a manipulating function is needed.

Returns:

A function which will perform an extraction in accordance with the desires of the ExtractionNamespace

buildReverseFn

public com.google.common.base.Function<String,List<String>> buildReverseFn(KafkaExtractionNamespace extractionNamespace,
                                                                           Map<String,String> cache)

Specified by:

buildReverseFn in interface ExtractionNamespaceFunctionFactory<KafkaExtractionNamespace>

Parameters:

extractionNamespace - The ExtractionNamespace for which a manipulating reverse function is needed.

cache - view of the cache containing the function mapping.

Returns:

A function that will perform reverse lookup.

getCachePopulator

public Callable<String> getCachePopulator(KafkaExtractionNamespace extractionNamespace,
                                          String unused,
                                          Map<String,String> cache)

Description copied from interface: ExtractionNamespaceFunctionFactory

This function is called once if `ExtractionNamespace.getUpdateMs() == 0`, or every update if `ExtractionNamespace.getUpdateMs() > 0` For ExtractionNamespace which have the NamespaceExtractionCacheManager handle regular updates, this function is used to populate the namespace cache each time. For ExtractionNamespace implementations which do not have regular updates, this function can be used to initialize resources. If the result of the Callable is the same as what is passed in as lastVersion, then no swap takes place, and the swap is discarded.

Specified by:

getCachePopulator in interface ExtractionNamespaceFunctionFactory<KafkaExtractionNamespace>

Parameters:

extractionNamespace - The ExtractionNamespace for which to populate data.

unused - The version which was last cached

cache - The temporary Map into which data may be placed and will be "swapped" with the proper namespace Map in NamespaceExtractionCacheManager. Implementations which cannot offer a swappable cache of the data may ignore this but must make sure `buildFn(...)` returns a proper Function.

Returns:

A callable that will be used to refresh resources of the namespace and return the version string used in the populating