Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1235

ByteBufLineReader can not read text line with CRLF

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: Storage
    • Labels:
      None

      Description

      Here is the problem example

      [text .. \r]  [\n text ..]
        buffer       buffer
      
      2014-12-05 13:46:35,355 ERROR org.apache.tajo.worker.Task: maxCapacity: -1 (expected: >= 0)
      java.lang.IllegalArgumentException: maxCapacity: -1 (expected: >= 0)
      at io.netty.buffer.AbstractByteBuf.<init>(AbstractByteBuf.java:51)
      at io.netty.buffer.AbstractDerivedByteBuf.<init>(AbstractDerivedByteBuf.java:28)
      at io.netty.buffer.SlicedByteBuf.<init>(SlicedByteBuf.java:40)
      at io.netty.buffer.AbstractByteBuf.slice(AbstractByteBuf.java:938)
      at org.apache.tajo.storage.text.ByteBufLineReader.readLineBuf(ByteBufLineReader.java:168)
      at org.apache.tajo.storage.text.DelimitedLineReader.readLine(DelimitedLineReader.java:125)
      at org.apache.tajo.storage.text.DelimitedTextFile$DelimitedTextFileScanner.init(DelimitedTextFile.java:328)
      at org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:226)
      at org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:200)
      at org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      at org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
      at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.init(HashShuffleFileWriteExec.java:83)
      at org.apache.tajo.worker.Task.run(Task.java:447)
      at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:276)
      at java.lang.Thread.run(Thread.java:745)
      

        Attachments

        1. TAJO-1235.patch
          11 kB
          Jinho Kim
        2. TAJO-1235_2.patch
          11 kB
          Jinho Kim

          Activity

            People

            • Assignee:
              jhkim Jinho Kim
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: