Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7022

Replace BinaryWritable with BytesWritable in Parquet serde

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.13.0
    • 0.14.0
    • Serializers/Deserializers
    • None

    Description

      Currently ParquetHiveSerde uses BinaryWritable to enclose bytes read from Parquet data. However, existing Hadoop class, BytesWritable, already does that, and BinaryWritable offers no advantage. On the other hand, BinaryWritable has a confusing getString() method, which, if misused, can cause unexpected result. The proposal here is to replace it with Hadoop BytesWritable.

      The issue was identified in HIVE-6367, serving as a follow-up JIRA.

      Attachments

        1. HIVE-7022.patch
          16 kB
          Xuefu Zhang

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HIVE-7073 Implement Binary in ParquetSerDe

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-6367 Implement Decimal in ParquetSerde

          • Major - Major loss of function.
          • Closed

          Activity

            People

              xuefuz Xuefu Zhang
              xuefuz Xuefu Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: