Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13968

CombineHiveInputFormat does not honor InputFormat that implements AvoidSplitCombination

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None

    Description

      If I have 100 path[] , the nonCombinablePaths will have only the paths paths[0-9] and the rest of the paths will be in combinablePaths, even if the inputformat returns false for AvoidSplitCombination.shouldSkipCombine() for all the paths.

      Attachments

        1. HIVE-13968.3.patch
          8 kB
          Prasanna Rajaperumal
        2. HIVE-13968.2.patch
          8 kB
          Prasanna Rajaperumal
        3. HIVE-13968.1.patch
          0.7 kB
          Prasanna Rajaperumal

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-20254 CheckNonCombinablePathCallable is buggy

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              prasanna.raj@gmail.com Prasanna Rajaperumal
              prasanna.raj@gmail.com Prasanna Rajaperumal
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: