Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-596

Parquet need to support empty list and empty map

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • parquet-format
    • None

    Description

      In current hive upstream 2.1version, when hive tried to insert empty list or empty map to parquet table, it fails with error:
      parquet.io.ParquetEncodingException: empty fields are illegal, the field should be ommited completely instead

      It seems now parquet only support null value, we should find a way to support empty list and empty map values.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ychena Yongzhi Chen
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment