Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20698

Better error instead of NPE when timestamp is null for any row when ingesting to druid

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Druid integration
    • Labels:
      None

      Description

      Currently when ingesting data to druid we get a wierd NPE when timestamp is null for any row.
      We should provide an error with a better message which helps user to know what is actually wrong.

       
      Caused by: java.lang.NullPointerException
        at org.apache.hadoop.hive.druid.serde.DruidSerDe.serialize(DruidSerDe.java:364)
        at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:957)
        at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)
        at org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:965)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:938)
        at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)
        at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:480)
      

        Attachments

        1. HIVE-20698.patch
          4 kB
          Nishant Bangarwa
        2. HIVE-20698.1.patch
          4 kB
          Nishant Bangarwa
        3. HIVE-20698.2.patch
          4 kB
          Nishant Bangarwa

          Activity

            People

            • Assignee:
              nishantbangarwa Nishant Bangarwa
              Reporter:
              nishantbangarwa Nishant Bangarwa
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: