Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-2001

DirectRawFileScanner.getProgress occasionally fails

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.11.1
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: Storage
    • Labels:
      None

      Description

      if getProgress is called after scanner is closed, ClosedChannelException can cause

      Here is the log

      2015-11-30 17:15:09,131 ERROR org.apache.tajo.storage.rawfile.DirectRawFileScanner:
      java.nio.channels.ClosedChannelException
              at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:109)
              at sun.nio.ch.FileChannelImpl.position(FileChannelImpl.java:252)
              at org.apache.tajo.storage.LocalFileInputChannel.position(LocalFileInputChannel.java:54)
              at org.apache.tajo.storage.rawfile.DirectRawFileScanner.getProgress(DirectRawFileScanner.java:221)
              at org.apache.tajo.engine.planner.physical.ExternalSortExec$PairWiseMerger.getProgress(ExternalSortExec.java:768)
              at org.apache.tajo.engine.planner.physical.ExternalSortExec$PairWiseMerger.getProgress(ExternalSortExec.java:768)
              at org.apache.tajo.engine.planner.physical.ExternalSortExec$PairWiseMerger.getProgress(ExternalSortExec.java:768)
              at org.apache.tajo.engine.planner.physical.ExternalSortExec.getProgress(ExternalSortExec.java:849)
              at org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.getProgress(UnaryPhysicalExec.java:87)
              at org.apache.tajo.worker.TaskImpl.updateProgress(TaskImpl.java:315)
              at org.apache.tajo.worker.ExecutionBlockContext$Reporter$1.run(ExecutionBlockContext.java:407)
              at java.lang.Thread.run(Thread.java:745)
      2015-11-30 17:15:09,131 ERROR org.apache.tajo.storage.rawfile.DirectRawFileScanner:
      java.nio.channels.ClosedChannelException
      

        Attachments

          Activity

            People

            • Assignee:
              jhkim Jinho Kim
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: