Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23799

Fix AcidUtils.parseBaseOrDeltaBucketFilename handling of data loaded by LOAD DATA

    XMLWordPrintableJSON

    Details

      Description

      Currently the AcidUtils.parseBaseOrDeltaBucketFilename considers files loaded to the table as original base files. We should fix that.
      Also by checking the code for AcidUtils.parseBaseOrDeltaBucketFilename, I have found 2 things:

      • The attribute copyNumber is not used anymore, so we should remove it
      • The version of the parsedDelta we use here tries to check if the files are in raw format, or not. We do not need this information here, so we can use a different implementation of parseDelta, and avoid a remote call and file read.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pvary Peter Vary
                Reporter:
                pvary Peter Vary
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m