Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14826 Support vectorization for Parquet
  3. HIVE-18211

Support to read multiple level definition for Map type in Parquet file

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • None
    • None

    Description

      For the current implementation with VectorizedParquetRecordReader, only following definition for map type is supported:

      repeated group map (MAP_KEY_VALUE) {
          required binary key (UTF8); optional binary value (UTF8);}
      }
      

      The implementation should support multiple level definition like:

      optional group m1 (MAP) {
          repeated group map (MAP_KEY_VALUE)
              {required binary key (UTF8); optional binary value (UTF8);}
      }
      

      Attachments

        1. HIVE-18211.002.patch
          6 kB
          Colin
        2. HIVE-18211.001.patch
          6 kB
          Colin

        Issue Links

          Activity

            People

              colin Colin
              colin Colin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: