Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Labels:
      None

      Description

      CREATE TABLE AS SELECT with PARTITION BY causes OOM.

      2014-01-28 10:28:34,827 INFO  worker.TaskAttemptContext (TaskAttemptContext.java:setState(106)) - Query status of ta_1390814036442_0004_000002_000004_00 is changed to TA_SUCCEEDED
      2014-01-28 10:28:34,827 INFO  worker.Task (Task.java:run(430)) - Task Counter - total:8, succeeded: 8, failed: 0
      2014-01-28 10:28:34,828 INFO  querymaster.SubQuery (SubQuery.java:transition(894)) - eb_1390814036442_0004_000002 SubQuery Succeeded 1/3 on local05.gruter.com:36108
      java.lang.OutOfMemoryError: unable to create new native thread
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:693)
        at org.apache.hadoop.hdfs.DFSOutputStream.start(DFSOutputStream.java:1814)
        at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1405)
        at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1382)
        at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1307)
        at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:384)
        at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:380)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:380)
        at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:324)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:905)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:886)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:783)2014-01-28 10:28:34,830 INFO  physical.ColumnPartitionedTableStoreExec (ColumnPartitionedTableStoreExec.java:getAppender(126)) - Add subpartition path directory :hdfs://127.0.0.1:8020/tmp/tajo-hyunsik/staging/q_1390814036442_0004/RESULT/receiptdate=1995-02-04
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:772)
        at org.apache.tajo.storage.CSVFile$CSVAppender.init(CSVFile.java:124)
        at org.apache.tajo.engine.planner.physical.ColumnPartitionedTableStoreExec.getAppender(ColumnPartitionedTableStoreExec.java:137)
        at org.apache.tajo.engine.planner.physical.ColumnPartitionedTableStoreExec.next(ColumnPartitionedTableStoreExec.java:169)
        at org.apache.tajo.worker.Task.run(Task.java:370)
        at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:392)
        at java.lang.Thread.run(Thread.java:724)
      

        Activity

        Hide
        hyunsik Hyunsik Choi added a comment - - edited

        It was fixed by TAJO-574.

        Show
        hyunsik Hyunsik Choi added a comment - - edited It was fixed by TAJO-574 .

          People

          • Assignee:
            hyunsik Hyunsik Choi
            Reporter:
            hyunsik Hyunsik Choi
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development