Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-1190

INSERT INTO to partition tables may cause NPE.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.10.0
    • None
    • None

    Description

      Reproduction

      tajo> CREATE EXTERNAL TABLE distinct_tb (distinct_id text) USING CSV PARTITION BY COLUMN (CNT TEXT) LOCATION '/user/hyunsik/test';
      OK
      
      > insert overwrite into distinct_tb (distinct_id) select l_returnflag from lineitem where l_orderkey = 1000 limit 1;
      default> insert overwrite into distinct_tb (distinct_id) select l_returnflag from lineitem where l_orderkey = 1000 limit 1;
      Progress: 0%, response time: 0.202 sec
      Progress: 0%, response time: 0.203 sec
      Progress: 0%, response time: 0.607 sec
      Progress: 11%, response time: 1.409 sec
      Progress: 28%, response time: 2.414 sec
      ERROR: java.lang.NullPointerException
      java.io.IOException: java.lang.NullPointerException
      	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:152)
      	at org.apache.tajo.worker.Task.run(Task.java:448)
      	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:276)
      	at java.lang.Thread.run(Thread.java:744)
      Caused by: java.lang.NullPointerException
      	at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.next(HashShuffleFileWriteExec.java:142)
      	... 3 more
      

      Description
      This problem actually includes three bugs: 1) NULL of InputStats of SeqScan, 2) NULL of getCause().getMessage in RemoteCallException, and 3) some null check bug in TajoWorkerClientService.

      This patch fixes the all bugs that I found.

      Attachments

        Activity

          People

            hyunsik Hyunsik Choi
            hyunsik Hyunsik Choi
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: