[TAJO-1149] Implement direct read of DelimitedTextFile

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Component/s: Storage
• Labels: performance
• Assignee: Jinho Kim
• Reporter: Jinho Kim
• Created: 31/Oct/14 12:07
• Updated: 10/Nov/14 08:07
• Resolved: 10/Nov/14 07:48

Description

If a text file is uncompressed, scanner is able to read from direct buffer
Other cases, it read from input stream.

This patch includes some refactoring as follows:

• rename properties
  • csvfile.delimiter to text.delimiter
  • csvfile.null to text.null

• Add DelimitedLineReader
  • it will be easier to implement text-format variations.

• Use the java Unsafe for split line and field
  • It will be better performance

• Remove seekable interface
  • We use the CSVFile to just debugging

Issue Links

• contains: TAJO-1100 Refactor CSVFile to DelimitedLineTextFile