Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-6484

[Java] Enable create indexType for DictionaryEncoding according to dictionary value count

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.15.0
    • Java

    Description

      Currently, when create DictionaryEncoding, we need to specify indexType, and it use Int(32, true) as default if this value is null.

      Actually, when dictionary valueCount is small, we should use Int(8,true)/Int(16,true) instead to reduce memory allocation.

      This issue is about to provide API for creating indexType according to valueCount and apply it to avro adapter for enum type.

      Attachments

        Issue Links

          Activity

            People

              tianchen92 Ji Liu
              tianchen92 Ji Liu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h