[TAJO-1235] ByteBufLineReader can not read text line with CRLF

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.10.0
• Component/s: Storage
• Assignee: Jinho Kim
• Reporter: Jinho Kim
• Created: 05/Dec/14 10:16
• Updated: 10/Dec/14 02:52
• Resolved: 10/Dec/14 02:26

Description

Here is the problem example

[text .. \r]  [\n text ..]
  buffer       buffer

2014-12-05 13:46:35,355 ERROR org.apache.tajo.worker.Task: maxCapacity: -1 (expected: >= 0)
java.lang.IllegalArgumentException: maxCapacity: -1 (expected: >= 0)
at io.netty.buffer.AbstractByteBuf.<init>(AbstractByteBuf.java:51)
at io.netty.buffer.AbstractDerivedByteBuf.<init>(AbstractDerivedByteBuf.java:28)
at io.netty.buffer.SlicedByteBuf.<init>(SlicedByteBuf.java:40)
at io.netty.buffer.AbstractByteBuf.slice(AbstractByteBuf.java:938)
at org.apache.tajo.storage.text.ByteBufLineReader.readLineBuf(ByteBufLineReader.java:168)
at org.apache.tajo.storage.text.DelimitedLineReader.readLine(DelimitedLineReader.java:125)
at org.apache.tajo.storage.text.DelimitedTextFile$DelimitedTextFileScanner.init(DelimitedTextFile.java:328)
at org.apache.tajo.engine.planner.physical.SeqScanExec.initScanner(SeqScanExec.java:226)
at org.apache.tajo.engine.planner.physical.SeqScanExec.init(SeqScanExec.java:200)
at org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
at org.apache.tajo.engine.planner.physical.UnaryPhysicalExec.init(UnaryPhysicalExec.java:53)
at org.apache.tajo.engine.planner.physical.HashShuffleFileWriteExec.init(HashShuffleFileWriteExec.java:83)
at org.apache.tajo.worker.Task.run(Task.java:447)
at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:276)
at java.lang.Thread.run(Thread.java:745)