Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9500

Support nested structs over 24 levels.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0
    • Component/s: None
    • Labels:

      Description

      Customer has deeply nested avro structure and is receiving the following error when performing queries.

      15/01/09 20:59:29 ERROR ql.Driver: FAILED: SemanticException org.apache.hadoop.hive.serde2.SerDeException: Number of levels of nesting supported for LazySimpleSerde is 23 Unable to work with level 24
      Currently we support up to 24 levels of nested structs when hive.serialization.extend.nesting.levels is set to true, while the customers have the requirement to support more than that.

      It would be better to make the supported levels configurable or completely removed (i.e., we can support any number of levels).

        Attachments

        1. HIVE-9500.4.patch
          409 kB
          Aihua Xu
        2. TClass.java
          3 kB
          Thejas M Nair
        3. HIVE-9500.3.patch
          406 kB
          Aihua Xu
        4. HIVE-9500.2.patch
          392 kB
          Aihua Xu
        5. HIVE-9500.1.patch
          88 kB
          Aihua Xu

          Issue Links

            Activity

              People

              • Assignee:
                aihuaxu Aihua Xu
                Reporter:
                aihuaxu Aihua Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: