Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-483

Data transfer (aka pipeline) implementation cannot tolerate exceptions

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: datanode, hdfs-client
    • Labels:
      None

      Description

      Data transfer was tested with simulated exceptions as below:

      1. create files with dfs
      2. write 1 byte
      3. close file
      4. open the same file
      5. read the 1 byte and compare results

      The file was closed successfully but we got an IOException(Could not get block locations...) when the file was reopened for reading.

      1. h483_20090709.patch
        15 kB
        Tsz Wo Nicholas Sze
      2. h483_20090713.patch
        18 kB
        Tsz Wo Nicholas Sze
      3. h483_20090717.patch
        17 kB
        Tsz Wo Nicholas Sze
      4. h483_20090727.patch
        17 kB
        Tsz Wo Nicholas Sze
      5. h483_20090730.patch
        20 kB
        Tsz Wo Nicholas Sze
      6. h483_20090731.patch
        24 kB
        Tsz Wo Nicholas Sze
      7. h483_20090806.patch
        27 kB
        Tsz Wo Nicholas Sze
      8. h483_20090807.patch
        32 kB
        Tsz Wo Nicholas Sze
      9. h483_20090807b.patch
        8 kB
        Tsz Wo Nicholas Sze
      10. h483_20090810.patch
        17 kB
        Tsz Wo Nicholas Sze
      11. h483_20090818.patch
        36 kB
        Tsz Wo Nicholas Sze
      12. h483_20090819.patch
        27 kB
        Tsz Wo Nicholas Sze
      13. h483_20090819b.patch
        31 kB
        Tsz Wo Nicholas Sze

        Issue Links

        There are no Sub-Tasks for this issue.

          Activity

          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Tom White made changes -
          Fix Version/s 0.22.0 [ 12314241 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-849 [ HDFS-849 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 0.21.0 [ 12314046 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090819b.patch [ 12417056 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090819.patch [ 12417042 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090818.patch [ 12416908 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-542 [ HDFS-542 ]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090810.patch [ 12416138 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090807b.patch [ 12415910 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090807.patch [ 12415876 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090709.patch [ 12415875 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090709.patch [ 12415875 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-451 [ HDFS-451 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090806.patch [ 12415770 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-521 [ HDFS-521 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090731.patch [ 12415206 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090730.patch [ 12415080 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HDFS-264 [ HDFS-264 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090727.patch [ 12414684 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-435 [ HDFS-435 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090717.patch [ 12413835 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment h483_20090713.patch [ 12413354 ]
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Attachment h483_20090709.patch [ 12413070 ]
          Tsz Wo Nicholas Sze created issue -

            People

            • Assignee:
              Unassigned
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development