[HIVE-19393] NonSyncDataInputBuffer.skipBytes hangs when the file is corrupted

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 1.0.0, 2.3.2
• Component/s: SQL
• Assignee: Unassigned
• Reporter: John Doe
• Created: 03/May/18 02:34
• Updated: 03/May/18 20:38
• Resolved: 03/May/18 20:35

Description

When an InputStream is corrupted, the InputStream.skip can return -1, causing the while loop in NonSyncDataInputBuffer.skipBytes become infinite.

  public final int skipBytes(int count) throws IOException {
    int skipped = 0;
    long skip;
    while (skipped < count && (skip = in.skip(count - skipped)) != 0) {
      skipped += skip;
    }
    if (skipped < 0) {
      throw new EOFException();
    }
    return skipped;
  }

Similar bugs are Hadoop-8614, Yarn-2905, Yarn-163, Mapreduce-6990

Issue Links

• Blocked: HIVE-18219 When InputStream is corrupted, the skip() returns -1, causing infinite loop