Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9067

OrcFileMergeOperator may create merge file that does not match properties of input files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.14.0, 0.14.1, 0.15.0
    • 1.0.0
    • None

    Description

      OrcFileMergeOperator creates a new ORC file and appends the stripes from smaller orc file. This new ORC file creation should retain the same configuration as the small ORC files. Currently it does not set the orc row index stride and file version. Also merging of stripe statistics to file statistics was incorrect leading to issues like in HIVE-9080

      Attachments

        1. HIVE-9067.1.patch
          5 kB
          Prasanth Jayachandran
        2. HIVE-9067.2.patch
          16 kB
          Prasanth Jayachandran

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-9080 ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review Board

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: