Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1190

INSERT INTO to partition tables may cause NPE.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      Reproduction

      tajo> CREATE EXTERNAL TABLE distinct_tb (distinct_id text) USING CSV PARTITION BY COLUMN (CNT TEXT) LOCATION '/user/hyunsik/test';
      OK
      
      > insert overwrite into distinct_tb (distinct_id) select l_returnflag from lineitem where l_orderkey = 1000 limit 1;
      default> insert overwrite into distinct_tb (distinct_id) select l_returnflag from lineitem where l_orderkey = 1000 limit 1;
      Progress: 0%, response time: 0.202 sec
      Progress: 0%, response time: 0.203 sec
      Progress: 0%, response time: 0.607 sec
      Progress: 11%, response time: 1.409 sec
      Progress: 28%, response time: 2.414 sec
      ERROR: java.lang.NullPointerException
      java.io.IOException: java.lang.NullPointerException
      	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:152)
      	at org.apache.tajo.worker.Task.run(Task.java:448)
      	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:276)
      	at java.lang.Thread.run(Thread.java:744)
      Caused by: java.lang.NullPointerException
      	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:142)
      	... 3 more
      

      Description
      This problem actually includes three bugs: 1) NULL of InputStats of SeqScan, 2) NULL of getCause().getMessage in RemoteCallException, and 3) some null check bug in TajoWorkerClientService.

      This patch fixes the all bugs that I found.

        Attachments

          Activity

            People

            • Assignee:
              hyunsik Hyunsik Choi
              Reporter:
              hyunsik Hyunsik Choi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: