Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9372

Parallel checking non-combinable paths in CombineHiveInputFormat

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • None
    • None

    Description

      Checking if an input path is combinable is expensive. So we should make it parallel.

      Attachments

        1. HIVE-9372.3-spark.patch
          8 kB
          Rui Li
        2. HIVE-9372.3-spark.patch
          8 kB
          Rui Li
        3. HIVE-9372.2.patch
          8 kB
          Rui Li
        4. HIVE-9372.2.patch
          8 kB
          Xuefu Zhang
        5. HIVE-9372.2.patch
          8 kB
          Rui Li
        6. HIVE-9372.1.patch
          6 kB
          Rui Li

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HIVE-9110 Performance of SELECT COUNT(*) FROM store_sales WHERE ss_item_sk IS NOT NULL [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lirui Rui Li
              lirui Rui Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: