Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4222

FixedLengthBinaryRecordReader should readFully

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.2.0
    • None
    • None

    Description

      The new FixedLengthBinaryRecordReader currently uses a read() call to read from the FSDataInputStream, without checking the number of bytes actually returned. The currentPosition variable is updated assuming that the full number of requested bytes are returned, which could lead to data corruption or other problems if fewer bytes come back than requested.

      Attachments

        Activity

          People

            jswisher Jascha Swisher
            jswisher Jascha Swisher
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: