io.druid.query.groupby

Class GroupByQueryQueryToolChest

java.lang.Object

io.druid.query.QueryToolChest<io.druid.data.input.Row,GroupByQuery>

io.druid.query.groupby.GroupByQueryQueryToolChest

public class GroupByQueryQueryToolChest
extends QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Constructor Summary

Constructors

Constructor and Description
GroupByQueryQueryToolChest(com.google.common.base.Supplier<GroupByQueryConfig> configSupplier, com.fasterxml.jackson.databind.ObjectMapper jsonMapper, GroupByQueryEngine engine, StupidPool<ByteBuffer> bufferPool, IntervalChunkingQueryRunnerDecorator intervalChunkingQueryRunnerDecorator)

Method Summary

Methods

Modifier and Type	Method and Description
static Collection<DimensionSpec>	extractionsToRewrite(GroupByQuery query) This function checks the query for dimensions which can be optimized by applying the dimension extraction as the final step of the query instead of on every event.
CacheStrategy<io.druid.data.input.Row,Object,GroupByQuery>	getCacheStrategy(GroupByQuery query) Returns a CacheStrategy to be used to load data into the cache and remove it from the cache.
com.fasterxml.jackson.core.type.TypeReference<io.druid.data.input.Row>	getResultTypeReference() Returns a TypeReference object that is just passed through to Jackson in order to deserialize the results of this type of query.
com.metamx.emitter.service.ServiceMetricEvent.Builder	makeMetricBuilder(GroupByQuery query) Creates a builder that is used to generate a metric for this specific query type.
com.google.common.base.Function<io.druid.data.input.Row,io.druid.data.input.Row>	makePostComputeManipulatorFn(GroupByQuery query, MetricManipulationFn fn) Generally speaking this is the exact same thing as makePreComputeManipulatorFn.
com.google.common.base.Function<io.druid.data.input.Row,io.druid.data.input.Row>	makePreComputeManipulatorFn(GroupByQuery query, MetricManipulationFn fn) Creates a Function that can take in a ResultType and return a new ResultType having applied the MetricManipulatorFn to each of the metrics.
QueryRunner<io.druid.data.input.Row>	mergeResults(QueryRunner<io.druid.data.input.Row> runner) This method wraps a QueryRunner.
com.metamx.common.guava.Sequence<io.druid.data.input.Row>	mergeSequences(com.metamx.common.guava.Sequence<com.metamx.common.guava.Sequence<io.druid.data.input.Row>> seqOfSequences) This method doesn't belong here, but it's here for now just to make it work.
com.metamx.common.guava.Sequence<io.druid.data.input.Row>	mergeSequencesUnordered(com.metamx.common.guava.Sequence<com.metamx.common.guava.Sequence<io.druid.data.input.Row>> seqOfSequences) This method doesn't belong here, but it's here for now just to make it work.
QueryRunner<io.druid.data.input.Row>	preMergeQueryDecoration(QueryRunner<io.druid.data.input.Row> runner) Wraps a QueryRunner.

Methods inherited from class io.druid.query.QueryToolChest

filterSegments, postMergeQueryDecoration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GroupByQueryQueryToolChest

@Inject
public GroupByQueryQueryToolChest(com.google.common.base.Supplier<GroupByQueryConfig> configSupplier,
                                 com.fasterxml.jackson.databind.ObjectMapper jsonMapper,
                                 GroupByQueryEngine engine,
                                 StupidPool<ByteBuffer> bufferPool,
                                 IntervalChunkingQueryRunnerDecorator intervalChunkingQueryRunnerDecorator)

Method Detail

mergeResults

public QueryRunner<io.druid.data.input.Row> mergeResults(QueryRunner<io.druid.data.input.Row> runner)

Description copied from class: QueryToolChest

This method wraps a QueryRunner. The input QueryRunner, by contract, will provide a series of ResultType objects in time order (ascending). This method should return a new QueryRunner that potentially merges the stream of ordered ResultType objects.

Specified by:

mergeResults in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

runner - A QueryRunner that provides a series of ResultType objects in time order (ascending)

Returns:

a QueryRunner that potentialy merges the stream of ordered ResultType objects

mergeSequences

public com.metamx.common.guava.Sequence<io.druid.data.input.Row> mergeSequences(com.metamx.common.guava.Sequence<com.metamx.common.guava.Sequence<io.druid.data.input.Row>> seqOfSequences)

Description copied from class: QueryToolChest

This method doesn't belong here, but it's here for now just to make it work. The method needs to take a Sequence of Sequences and return a single Sequence of ResultType objects in time-order (ascending) This method assumes that its input sequences provide values already in sorted order. Even more specifically, it assumes that the individual sequences are also ordered by their first element. In the vast majority of cases, this should just be implemented with: return new OrderedMergeSequence<>(getOrdering(), seqOfSequences);

Specified by:

mergeSequences in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

seqOfSequences - sequence of sequences to be merged

Returns:

the sequence of merged results

mergeSequencesUnordered

public com.metamx.common.guava.Sequence<io.druid.data.input.Row> mergeSequencesUnordered(com.metamx.common.guava.Sequence<com.metamx.common.guava.Sequence<io.druid.data.input.Row>> seqOfSequences)

Description copied from class: QueryToolChest

This method doesn't belong here, but it's here for now just to make it work. The method needs to take a Sequence of Sequences and return a single Sequence of ResultType objects in time-order (ascending) This method assumes that its input sequences provide values already in sorted order, but, unlike mergeSequences, it does *not* assume that the individual sequences are also ordered by their first element. In the vast majority if ocases, this hsould just be implemented with: return new MergeSequence<>(getOrdering(), seqOfSequences);

Specified by:

mergeSequencesUnordered in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

seqOfSequences - sequence of sequences to be merged

Returns:

the sequence of merged results

makeMetricBuilder

public com.metamx.emitter.service.ServiceMetricEvent.Builder makeMetricBuilder(GroupByQuery query)

Description copied from class: QueryToolChest

Creates a builder that is used to generate a metric for this specific query type. This exists to allow for query-specific dimensions on metrics. That is, the ToolChest is expected to set some meaningful dimensions for metrics given this query type. Examples might be the topN threshhold for a TopN query or the number of dimensions included for a groupBy query.

Specified by:

makeMetricBuilder in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

query - The query that is being processed

Returns:

A MetricEvent.Builder that can be used to make metrics for the provided query

makePreComputeManipulatorFn

public com.google.common.base.Function<io.druid.data.input.Row,io.druid.data.input.Row> makePreComputeManipulatorFn(GroupByQuery query,
                                                                                                           MetricManipulationFn fn)

Description copied from class: QueryToolChest

Creates a Function that can take in a ResultType and return a new ResultType having applied the MetricManipulatorFn to each of the metrics. This exists because the QueryToolChest is the only thing that understands the internal serialization format of ResultType, so it's primary responsibility is to "decompose" that structure and apply the given function to all metrics. This function is called very early in the processing pipeline on the Broker.

Specified by:

makePreComputeManipulatorFn in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

query - The Query that is currently being processed

fn - The function that should be applied to all metrics in the results

Returns:

A function that will apply the provided fn to all metrics in the input ResultType object

makePostComputeManipulatorFn

public com.google.common.base.Function<io.druid.data.input.Row,io.druid.data.input.Row> makePostComputeManipulatorFn(GroupByQuery query,
                                                                                                            MetricManipulationFn fn)

Description copied from class: QueryToolChest

Generally speaking this is the exact same thing as makePreComputeManipulatorFn. It is leveraged in order to compute PostAggregators on results after they have been completely merged together, which should actually be done in the mergeResults() call instead of here. This should never actually be overridden and it should be removed as quickly as possible.

Overrides:

makePostComputeManipulatorFn in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

query - The Query that is currently being processed

fn - The function that should be applied to all metrics in the results

Returns:

A function that will apply the provided fn to all metrics in the input ResultType object

getResultTypeReference

public com.fasterxml.jackson.core.type.TypeReference<io.druid.data.input.Row> getResultTypeReference()

Description copied from class: QueryToolChest

Returns a TypeReference object that is just passed through to Jackson in order to deserialize the results of this type of query.

Specified by:

getResultTypeReference in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Returns:

A TypeReference to indicate to Jackson what type of data will exist for this query

preMergeQueryDecoration

public QueryRunner<io.druid.data.input.Row> preMergeQueryDecoration(QueryRunner<io.druid.data.input.Row> runner)

Description copied from class: QueryToolChest

Wraps a QueryRunner. The input QueryRunner is the QueryRunner as it exists *before* being passed to mergeResults(). In fact, the return value of this method is always passed to mergeResults, so it is equivalent to just implement this functionality as extra decoration on the QueryRunner during mergeResults(). In the interests of potentially simplifying these interfaces, the recommendation is to actually not override this method and instead apply anything that might be needed here in the mergeResults() call.

Overrides:

preMergeQueryDecoration in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

runner - The runner to be wrapped

Returns:

The wrapped runner

getCacheStrategy

public CacheStrategy<io.druid.data.input.Row,Object,GroupByQuery> getCacheStrategy(GroupByQuery query)

Description copied from class: QueryToolChest

Returns a CacheStrategy to be used to load data into the cache and remove it from the cache. This is optional. If it returns null, caching is effectively disabled for the query.

Overrides:

getCacheStrategy in class QueryToolChest<io.druid.data.input.Row,GroupByQuery>

Parameters:

query - The query whose results might be cached

Returns:

A CacheStrategy that can be used to populate and read from the Cache

extractionsToRewrite

public static Collection<DimensionSpec> extractionsToRewrite(GroupByQuery query)

This function checks the query for dimensions which can be optimized by applying the dimension extraction as the final step of the query instead of on every event.

Parameters:

query - The query to check for optimizations

Returns:

A collection of DimensionsSpec which can be extracted at the last second upon query completion.