Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6059

Add union type support in LazyBinarySerDe

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.12.0
    • None
    • File Formats
    • None

    Description

      We need the support to type union in LazyBinarySerDe, which is required to the join query with any union types in its select values. The reduce values in Join operation is serialized/deserialized using LazyBinarySerDe, otherwise we will see some errors like:

      Caused by: java.lang.NullPointerException
      at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardObjectInspector(ObjectInspectorUtils.java:106)
      at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardObjectInspector(ObjectInspectorUtils.java:156)
      at org.apache.hadoop.hive.ql.exec.JoinUtil.getStandardObjectInspectors(JoinUtil.java:98)
      at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.initializeOp(CommonJoinOperator.java:261)
      at org.apache.hadoop.hive.ql.exec.JoinOperator.initializeOp(JoinOperator.java:61)
      at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:360)
      at org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:150)
      

      Attachments

        1. Hive Issue 0.jpeg
          1.18 MB
          Doug Houck
        2. Hive Issue 1.jpeg
          1.02 MB
          Doug Houck
        3. Hive Issue 2.jpeg
          1.74 MB
          Doug Houck
        4. Hive Issue 3.jpeg
          974 kB
          Doug Houck
        5. repro.tar
          10 kB
          Johndee Burks

        Activity

          People

            Unassigned Unassigned
            ctang Chaoyu Tang
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: