[DRILL-7258] [Text V3 Reader] Unsupported operation error is thrown when select a column with a long string

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.16.0
• Fix Version/s: 1.17.0
• Labels: ready-to-commit
• Assignee: Paul Rogers
• Reporter: Anton Gozhiy
• Reviewer: Arina Ielchiieva
• Created: 14/May/19 15:46
• Updated: 11/Jun/19 16:31
• Resolved: 07/Jun/19 10:42

Description

Data:
100000.tbl is attached

Steps:

1. Set exec.storage.enable_v3_text_reader=true
2. Run the following query:

   select * from dfs.`/tmp/drill/data/100000.tbl`
   

Expected result:
The query should return result normally.

Actual result:
Exception is thrown:

UNSUPPORTED_OPERATION ERROR: Drill Remote Exception



  (java.lang.Exception) UNSUPPORTED_OPERATION ERROR: Text column is too large.

Column 0
Limit 65536
Fragment 0:0

[Error Id: 5f73232f-f0c0-48aa-ab0f-b5f86495d3c8 on userf87d-pc:31010]
    org.apache.drill.common.exceptions.UserException$Builder.build():630
    org.apache.drill.exec.store.easy.text.compliant.v3.BaseFieldOutput.append():131
    org.apache.drill.exec.store.easy.text.compliant.v3.TextReader.parseValueAll():208
    org.apache.drill.exec.store.easy.text.compliant.v3.TextReader.parseValue():225
    org.apache.drill.exec.store.easy.text.compliant.v3.TextReader.parseField():341
    org.apache.drill.exec.store.easy.text.compliant.v3.TextReader.parseRecord():137
    org.apache.drill.exec.store.easy.text.compliant.v3.TextReader.parseNext():388
    org.apache.drill.exec.store.easy.text.compliant.v3.CompliantTextBatchReader.next():220
    org.apache.drill.exec.physical.impl.scan.framework.ShimBatchReader.next():132
    org.apache.drill.exec.physical.impl.scan.ReaderState.readBatch():397
    org.apache.drill.exec.physical.impl.scan.ReaderState.next():354
    org.apache.drill.exec.physical.impl.scan.ScanOperatorExec.nextAction():184
    org.apache.drill.exec.physical.impl.scan.ScanOperatorExec.next():159
    org.apache.drill.exec.physical.impl.protocol.OperatorDriver.doNext():176
    org.apache.drill.exec.physical.impl.protocol.OperatorDriver.next():114
    org.apache.drill.exec.physical.impl.protocol.OperatorRecordBatch.next():147
    org.apache.drill.exec.record.AbstractRecordBatch.next():126
    org.apache.drill.exec.record.AbstractRecordBatch.next():116
    org.apache.drill.exec.record.AbstractUnaryRecordBatch.innerNext():63
    org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():141
    org.apache.drill.exec.record.AbstractRecordBatch.next():186
    org.apache.drill.exec.physical.impl.BaseRootExec.next():104
    org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext():83
    org.apache.drill.exec.physical.impl.BaseRootExec.next():94
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():296
    org.apache.drill.exec.work.fragment.FragmentExecutor$1.run():283
    .......():0
    org.apache.hadoop.security.UserGroupInformation.doAs():1746
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():283
    org.apache.drill.common.SelfCleaningRunnable.run():38
    .......():0

Note: works fine with v2 reader.

Issue Links

• is duplicated by: DRILL-7020 big varchar doesn't work with extractHeader=true
• links to: GitHub Pull Request #1802