Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20468

Add ability to skip creating druid bitmap indexes for specific string dimensions

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Druid integration
    • Labels:
      None

      Description

      Currently we create bitmap index for all druid dimensions.
      For some columns (e.g Free form text, high cardinality columns that are rarely filtered upon), It may be beneficial to skip creating druid bitmap index and save disk space.

      In druid https://github.com/apache/incubator-druid/pull/5402 added support for creating string dimension columns without bitmap indexes.
      This task is to add similar option when indexing data from hive.

        Attachments

          Activity

            People

            • Assignee:
              nishantbangarwa Nishant Bangarwa
              Reporter:
              nishantbangarwa Nishant Bangarwa
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: