Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3531

EditLogFileOutputStream#preallocate should check for incomplete writes

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.2-alpha
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We need to check for short writes when using WritableByteChannel#write and related methods in EditLogFileOutputStream#preallocate so we ensure we've preallocated sufficient space.

      1. HADOOP-8491.001.patch
        5 kB
        Colin Patrick McCabe
      2. HADOOP-8491.002.patch
        5 kB
        Colin Patrick McCabe
      3. hadoop-8491.txt
        5 kB
        Eli Collins
      4. hadoop-8491.txt
        5 kB
        Eli Collins

        Issue Links

          Activity

          Colin Patrick McCabe created issue -
          Colin Patrick McCabe made changes -
          Field Original Value New Value
          Link This issue relates to HDFS-3479 [ HDFS-3479 ]
          Colin Patrick McCabe made changes -
          Link This issue relates to HDFS-3510 [ HDFS-3510 ]
          Colin Patrick McCabe made changes -
          Attachment HADOOP-8491.001.patch [ 12531435 ]
          Colin Patrick McCabe made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Eli Collins made changes -
          Affects Version/s 2.0.0-alpha [ 12320352 ]
          Target Version/s 2.0.1-alpha [ 12321441 ]
          Colin Patrick McCabe made changes -
          Attachment HADOOP-8491.002.patch [ 12531694 ]
          Colin Patrick McCabe made changes -
          Attachment HADOOP-8491.003.patch [ 12531697 ]
          Colin Patrick McCabe made changes -
          Attachment HADOOP-8491.003.patch [ 12531697 ]
          Eli Collins made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Summary We need to check for short writes when using FileChannel#write and related methods Check for short writes when using FileChannel#write and related methods
          Eli Collins made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Target Version/s 2.0.1-alpha [ 12321441 ]
          Fix Version/s 2.0.1-alpha [ 12321441 ]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Eli Collins made changes -
          Attachment hadoop-8491.txt [ 12531777 ]
          Eli Collins made changes -
          Status Reopened [ 4 ] Patch Available [ 10002 ]
          Eli Collins made changes -
          Attachment hadoop-8491.txt [ 12531884 ]
          Eli Collins made changes -
          Project Hadoop Common [ 12310240 ] Hadoop HDFS [ 12310942 ]
          Key HADOOP-8491 HDFS-3531
          Affects Version/s 2.0.0-alpha [ 12320353 ]
          Affects Version/s 2.0.0-alpha [ 12320352 ]
          Fix Version/s 2.0.1-alpha [ 12321440 ]
          Fix Version/s 2.0.1-alpha [ 12321441 ]
          Eli Collins made changes -
          Summary Check for short writes when using FileChannel#write and related methods EditLogFileOutputStream#preallocate should check for incomplete writes
          Description We need to check for short writes when using WritableByteChannel#write and related methods. We need to check for short writes when using WritableByteChannel#write and related methods in EditLogFileOutputStream#preallocate so we ensure we've preallocated sufficient space.
          Eli Collins made changes -
          Fix Version/s 2.0.1-alpha [ 12321440 ]
          Target Version/s 2.0.1-alpha [ 12321440 ]
          Component/s name-node [ 12312926 ]
          Eli Collins made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Target Version/s 2.0.1-alpha [ 12321440 ]
          Fix Version/s 2.0.1-alpha [ 12321440 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322472 ]
          Fix Version/s 2.1.0-alpha [ 12321440 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Colin Patrick McCabe
              Reporter:
              Colin Patrick McCabe
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development