Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-485

'CREATE TABLE AS' does not work properly with partition

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: Planner/Optimizer
    • Labels:
      None

      Description

      Currently, the TestCTASQuery ran successfully but this is wrong.
      The test case should check result size.

      2014-01-08 12:03:52,389 INFO  worker.TaskRunnerManager (TaskRunnerManager.java:run(188)) - Start TaskRunner:eb_1389150227306_0002_000001,container_1389150227306_0002_01_000003
      2014-01-08 12:03:52,390 INFO  worker.TaskRunner (TaskRunner.java:init(187)) - TaskRunner basedir is created (q_1389150227306_0002/output/1)
      2014-01-08 12:03:52,390 INFO  worker.TaskRunner (TaskRunner.java:run(314)) - TaskRunner startup
      2014-01-08 12:03:52,391 INFO  worker.TaskRunner (TaskRunner.java:run(334)) - Request GetTask: eb_1389150227306_0002_000001,container_1389150227306_0002_01_000003
      2014-01-08 12:03:52,392 INFO  master.DefaultTaskScheduler (DefaultTaskScheduler.java:handle(233)) - TaskRequest: container_1389150227306_0002_01_000003,eb_1389150227306_0002_000001
      2014-01-08 12:03:52,485 INFO  worker.TaskRunner (TaskRunner.java:run(372)) - Accumulated Received Task: 1
      2014-01-08 12:03:52,485 INFO  worker.TaskRunner (TaskRunner.java:run(380)) - Initializing: ta_1389150227306_0002_000001_000000_00
      2014-01-08 12:03:52,491 INFO  worker.Task (Task.java:<init>(180)) - Output File Path: hdfs://localhost:57630/tmp/tajo-kimjh/staging/q_1389150227306_0002/RESULT/part-01-000000
      2014-01-08 12:03:52,492 INFO  worker.TaskAttemptContext (TaskAttemptContext.java:setState(106)) - Query status of ta_1389150227306_0002_000001_000000_00 is changed to TA_PENDING
      2014-01-08 12:03:52,492 INFO  worker.Task (Task.java:<init>(185)) - ==================================
      2014-01-08 12:03:52,492 INFO  worker.Task (Task.java:<init>(186)) - * Subquery ta_1389150227306_0002_000001_000000_00 is initialized
      2014-01-08 12:03:52,492 INFO  worker.Task (Task.java:<init>(187)) - * InterQuery: false
      2014-01-08 12:03:52,492 INFO  worker.Task (Task.java:<init>(190)) - * Fragments (num: 1)
      2014-01-08 12:03:52,493 INFO  worker.Task (Task.java:<init>(191)) - * Fetches (total:0) :
      2014-01-08 12:03:52,493 INFO  worker.Task (Task.java:<init>(195)) - * Local task dir: file:/XXXX/incubator-tajo/target/test-data/b81063cb-d489-4b27-9900-c5aacf40e66e/tajo-localdir/q_1389150227306_0002/output/1/0_0
      2014-01-08 12:03:52,493 INFO  worker.Task (Task.java:<init>(200)) - ==================================
      2014-01-08 12:03:52,494 INFO  worker.TaskAttemptContext (TaskAttemptContext.java:setState(106)) - Query status of ta_1389150227306_0002_000001_000000_00 is changed to TA_RUNNING
      2014-01-08 12:03:52,517 ERROR worker.Task (Task.java:run(378)) - java.lang.NullPointerException
      	at org.apache.tajo.catalog.Schema.getColumnId(Schema.java:142)
      	at org.apache.tajo.engine.eval.FieldEval.eval(FieldEval.java:51)
      	at org.apache.tajo.engine.planner.Projector.eval(Projector.java:87)
      	at org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:174)
      	at org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:69)
      	at org.apache.tajo.worker.Task.run(Task.java:370)
      	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:392)
      	at java.lang.Thread.run(Thread.java:695)
      

        Issue Links

          Activity

          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Tajo-master-build #7 (See https://builds.apache.org/job/Tajo-master-build/7/)
          TAJO-485: 'CREATE TABLE AS' does not work properly with partition. (jinho) (jinossy: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=29ae398073d2642c098bdc990b24902af20c892d)

          • tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/query/TestTablePartitions.java
          • CHANGES.txt
          • tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/engine/planner/physical/SeqScanExec.java
          • tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/query/TestCTASQuery.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-build #7 (See https://builds.apache.org/job/Tajo-master-build/7/ ) TAJO-485 : 'CREATE TABLE AS' does not work properly with partition. (jinho) (jinossy: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=29ae398073d2642c098bdc990b24902af20c892d ) tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/query/TestTablePartitions.java CHANGES.txt tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/engine/planner/physical/SeqScanExec.java tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/query/TestCTASQuery.java
          Hide
          jhkim Jinho Kim added a comment -

          This issue got +1 from reviewboard.
          I've just committed it to master branch.

          Show
          jhkim Jinho Kim added a comment - This issue got +1 from reviewboard. I've just committed it to master branch.
          Hide
          jhkim Jinho Kim added a comment -

          Created a review request against branch master in reviewboard
          https://reviews.apache.org/r/16819/

          Show
          jhkim Jinho Kim added a comment - Created a review request against branch master in reviewboard https://reviews.apache.org/r/16819/

            People

            • Assignee:
              jhkim Jinho Kim
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development