io.druid.segment

Class StringDimensionMergerLegacy

java.lang.Object

io.druid.segment.StringDimensionMergerV9

io.druid.segment.StringDimensionMergerLegacy

All Implemented Interfaces:

DimensionMerger<int[]>, DimensionMergerLegacy<int[]>, DimensionMergerV9<int[]>

public class StringDimensionMergerLegacy
extends StringDimensionMergerV9
implements DimensionMergerLegacy<int[]>

Nested Class Summary

Nested classes/interfaces inherited from class io.druid.segment.StringDimensionMergerV9

StringDimensionMergerV9.ConvertingIndexedInts, StringDimensionMergerV9.IndexSeeker, StringDimensionMergerV9.IndexSeekerWithConversion, StringDimensionMergerV9.IndexSeekerWithoutConversion

Field Summary

Fields inherited from class io.druid.segment.StringDimensionMergerV9

adapters, bitmapWriter, capabilities, cardinality, convertMissingValues, dictionaryWriter, dimConversions, dimensionName, EMPTY_STR_DIM_ARRAY, EMPTY_STR_DIM_VAL, hasNull, indexSpec, ioPeon, nullRowsBitmap, outDir, progress, rowCount, spatialWriter, SPLITTER

Constructor Summary

Constructors

Constructor and Description
StringDimensionMergerLegacy(String dimensionName, IndexSpec indexSpec, File outDir, IOPeon ioPeon, ColumnCapabilities capabilities, ProgressIndicator progress)

Method Summary

Modifier and Type	Method and Description
File	makeDimFile()
protected void	processMergedRowHelper(int[] vals)
protected void	setupEncodedValueWriter()
void	writeIndexes(List<IntBuffer> segmentRowNumConversions, com.google.common.io.Closer closer) Internally construct any index structures relevant to this DimensionMerger.
void	writeIndexesToFiles(com.google.common.io.ByteSink invertedIndexFile, com.google.common.io.OutputSupplier<FileOutputStream> spatialIndexFile) Write this dimension's bitmap and spatial indexes to a file.
void	writeRowValuesToFile(FileOutputSupplier rowValueFile) Write this dimension's sequence of row values to a file.
void	writeValueMetadataToFile(FileOutputSupplier valueEncodingFile) Write this dimension's value metadata to a file.

Methods inherited from class io.druid.segment.StringDimensionMergerV9

canSkip, convertSegmentRowValuesToMergedRowValues, isNullColumn, makeColumnDescriptor, processMergedRow, toIndexSeekers, writeMergedValueMetadata

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.druid.segment.DimensionMergerV9

makeColumnDescriptor

Methods inherited from interface io.druid.segment.DimensionMerger

canSkip, convertSegmentRowValuesToMergedRowValues, processMergedRow, writeMergedValueMetadata

Constructor Detail

StringDimensionMergerLegacy

public StringDimensionMergerLegacy(String dimensionName,
                                   IndexSpec indexSpec,
                                   File outDir,
                                   IOPeon ioPeon,
                                   ColumnCapabilities capabilities,
                                   ProgressIndicator progress)

Method Detail

setupEncodedValueWriter

protected void setupEncodedValueWriter()
                                throws IOException

Overrides:

setupEncodedValueWriter in class StringDimensionMergerV9

Throws:

IOException

processMergedRowHelper

protected void processMergedRowHelper(int[] vals)
                               throws IOException

Overrides:

processMergedRowHelper in class StringDimensionMergerV9

Throws:

IOException

writeIndexes

public void writeIndexes(List<IntBuffer> segmentRowNumConversions,
                         com.google.common.io.Closer closer)
                  throws IOException

Description copied from interface: DimensionMerger

Internally construct any index structures relevant to this DimensionMerger. After receiving the sequence of merged rows via iterated processMergedRow() calls, the DimensionMerger can now build any index structures it needs. For example, a dictionary encoded String implementation would create its bitmap indexes for the merged segment during this step. The index merger will provide a list of row number conversion IntBuffer objects. Each IntBuffer is associated with one of the segments being merged; the position of the IntBuffer in the list corresponds to the position of segment adapters within the input list of writeMergedValueMetadata(). For example, suppose there are two segments A and B. Row 24 from segment A maps to row 99 in the merged sequence of rows, The IntBuffer for segment A would have a mapping of 24 -> 99.

Specified by:

writeIndexes in interface DimensionMerger<int[]>

Overrides:

writeIndexes in class StringDimensionMergerV9

Parameters:

segmentRowNumConversions - A list of row number conversion IntBuffer objects.

closer - Add Closeables for resource cleanup to this Closer if needed

Throws:

IOException

writeValueMetadataToFile

public void writeValueMetadataToFile(FileOutputSupplier valueEncodingFile)
                              throws IOException

Description copied from interface: DimensionMergerLegacy

Write this dimension's value metadata to a file.

Specified by:

writeValueMetadataToFile in interface DimensionMergerLegacy<int[]>

Parameters:

valueEncodingFile - Destination file

Throws:

IOException

writeRowValuesToFile

public void writeRowValuesToFile(FileOutputSupplier rowValueFile)
                          throws IOException

Description copied from interface: DimensionMergerLegacy

Write this dimension's sequence of row values to a file.

Specified by:

writeRowValuesToFile in interface DimensionMergerLegacy<int[]>

Parameters:

rowValueFile - Destination file

Throws:

IOException

writeIndexesToFiles

public void writeIndexesToFiles(com.google.common.io.ByteSink invertedIndexFile,
                                com.google.common.io.OutputSupplier<FileOutputStream> spatialIndexFile)
                         throws IOException

Description copied from interface: DimensionMergerLegacy

Write this dimension's bitmap and spatial indexes to a file.

Specified by:

writeIndexesToFiles in interface DimensionMergerLegacy<int[]>

Parameters:

invertedIndexFile - Destination file for bitmap indexes

spatialIndexFile - Destination file for spatial indexes

Throws:

IOException

makeDimFile

public File makeDimFile()
                 throws IOException

Specified by:

makeDimFile in interface DimensionMergerLegacy<int[]>

Throws:

IOException