io.druid.benchmark

Class BitmapIterationBenchmark

java.lang.Object

io.druid.benchmark.BitmapIterationBenchmark

public class BitmapIterationBenchmark
extends Object

Benchmarks of bitmap iteration and iteration + something (cumulative cost), the latter is useful for comparing total "usage cost" of different BitmapSerdeFactory.

See Also:

iter(IterState), constructAndIter(ConstructAndIterState), intersectionAndIter(BitmapsForIntersection), unionAndIter(BitmapsForUnion)

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BitmapIterationBenchmark.BitmapsForIntersection
static class	BitmapIterationBenchmark.BitmapsForUnion
static class	BitmapIterationBenchmark.ConstructAndIterState
static class	BitmapIterationBenchmark.IterState

Field Summary

Fields

Modifier and Type	Field and Description
String	bitmapAlgo
double	prob Fraction of set bits in the bitmaps to iterate.
int	size The size of all bitmaps, i.

Constructor Summary

Constructors

Constructor and Description
BitmapIterationBenchmark()

Method Summary

Modifier and Type	Method and Description
int	constructAndIter(BitmapIterationBenchmark.ConstructAndIterState state) Benchmark of cumulative cost of construction of an immutable bitmap and then iterating over it.
int	intersectionAndIter(BitmapIterationBenchmark.BitmapsForIntersection state) Benchmark of cumulative cost of bitmap intersection with subsequent iteration over the result.
int	iter(BitmapIterationBenchmark.IterState state) General benchmark of bitmap iteration, this is a part of IndexMerger.merge(java.util.List<io.druid.segment.IndexableAdapter>, boolean, io.druid.query.aggregation.AggregatorFactory[], java.io.File, io.druid.segment.IndexSpec) and query processing on both realtime and historical nodes.
static void	main(String[] args) This main() is for debugging from the IDE.
void	setup()
int	unionAndIter(BitmapIterationBenchmark.BitmapsForUnion state) Benchmark of cumulative cost of bitmap union with subsequent iteration over the result.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

bitmapAlgo

public String bitmapAlgo

prob

public double prob

Fraction of set bits in the bitmaps to iterate. For intersectionAndIter(io.druid.benchmark.BitmapIterationBenchmark.BitmapsForIntersection) and unionAndIter(io.druid.benchmark.BitmapIterationBenchmark.BitmapsForUnion), this is the fraction of set bits in the final result of intersection or union.

size

public int size

The size of all bitmaps, i. e. the number of rows in a segment for the most bitmap use cases.

Constructor Detail

BitmapIterationBenchmark

public BitmapIterationBenchmark()

Method Detail

setup

public void setup()

iter

public int iter(BitmapIterationBenchmark.IterState state)

General benchmark of bitmap iteration, this is a part of IndexMerger.merge(java.util.List<io.druid.segment.IndexableAdapter>, boolean, io.druid.query.aggregation.AggregatorFactory[], java.io.File, io.druid.segment.IndexSpec) and query processing on both realtime and historical nodes.

constructAndIter

public int constructAndIter(BitmapIterationBenchmark.ConstructAndIterState state)

Benchmark of cumulative cost of construction of an immutable bitmap and then iterating over it. This is a pattern from realtime nodes, see StringDimensionIndexer.fillBitmapsFromUnsortedEncodedKeyComponent(int[], int, io.druid.collections.bitmap.MutableBitmap[], io.druid.collections.bitmap.BitmapFactory). However this benchmark is yet approximate and to be improved to better reflect actual workloads of realtime nodes.

intersectionAndIter

public int intersectionAndIter(BitmapIterationBenchmark.BitmapsForIntersection state)

Benchmark of cumulative cost of bitmap intersection with subsequent iteration over the result. This is a pattern from query processing of historical nodes, when AndFilter is used.

unionAndIter

public int unionAndIter(BitmapIterationBenchmark.BitmapsForUnion state)

Benchmark of cumulative cost of bitmap union with subsequent iteration over the result. This is a pattern from query processing on historical nodes, when filters like DimensionPredicateFilter, RegexDimFilter, SearchQueryDimFilter and similar are used.

main

public static void main(String[] args)

This main() is for debugging from the IDE.