Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-6652

Problem with DelimitedInputFormat

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.1
    • Fix Version/s: 1.2.2, 1.3.1, 1.4.0
    • Component/s: API / DataSet
    • Labels:
      None

      Description

      After upgrading from Flink 1.2.0 to 1.2.1 I got the following error
      ```
      07:54:52,395 ERROR org.apache.flink.api.common.io.DelimitedInputFormat - Unexpected problen while getting the file statistics for file 'mytestfile': -1
      java.lang.ArrayIndexOutOfBoundsException: -1
      at org.apache.flink.api.common.io.DelimitedInputFormat.readLine(DelimitedInputFormat.java:572)
      at org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics(DelimitedInputFormat.java:423)
      at org.apache.flink.api.common.io.DelimitedInputFormat.getStatistics(DelimitedInputFormat.java:48)
      at org.apache.flink.optimizer.dag.DataSourceNode.computeOperatorSpecificDefaultEstimates(DataSourceNode.java:166)
      ```
      I have created a test repo to isolate the issue here
      https://github.com/physikerwelt/flinkReadTest
      and reproduced the bug using travis
      https://travis-ci.org/physikerwelt/flinkReadTest

        Attachments

          Activity

            People

            • Assignee:
              fhueske Fabian Hueske
              Reporter:
              physikerwelt Moritz Schubotz

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment