Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20374

Write Hive version information to Parquet footer

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: None
    • Labels:
      None

      Description

      PARQUET-352 added support for the "writer.model.name" property in the Parquet metadata to identify the object model (application) that wrote the file.

      The easiest way to write this property is by overriding getName() of org.apache.parquet.hadoop.api.WriteSupport. In Hive, this would mean adding getName() to the org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriteSupport class.

        Attachments

        1. HIVE-20374.01.patch
          1.0 kB
          Laszlo Pinter
        2. HIVE-20374.02.patch
          8 kB
          Laszlo Pinter
        3. HIVE-20374.03.patch
          16 kB
          Laszlo Pinter
        4. HIVE-20374.04.patch
          15 kB
          Laszlo Pinter
        5. HIVE-20374.patch
          1.0 kB
          Laszlo Pinter

          Activity

            People

            • Assignee:
              lpinter Laszlo Pinter
              Reporter:
              zi Zoltan Ivanfi
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: