Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18110

OrcInputFormat.combineOrCreateETLStrategy() doesn't combine if there are deltas

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • Transactions
    • None

    Description

      this method has

          if (!deltas.isEmpty() || combinedCtx == null) {
            //why is this checking for deltas.isEmpty() - is this Acid 1.0 remnant?
            return new ETLSplitStrategy(
                context, fs, dir, files, readerTypes, isOriginal, deltas, covered, ugi,
                allowSyntheticFileIds, isDefaultFs);
          } else
      

      what is the purpose of checking deltas? (here with Acid 2.0 deltas is delete deltas)
      Is this some remnant of Acid 1.0?

      Also see TestInputOutputFormat.testEtlCombinedStrategy

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: