Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-483

Data transfer (aka pipeline) implementation cannot tolerate exceptions

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • datanode, hdfs-client
    • None

    Description

      Data transfer was tested with simulated exceptions as below:

      1. create files with dfs
      2. write 1 byte
      3. close file
      4. open the same file
      5. read the 1 byte and compare results

      The file was closed successfully but we got an IOException(Could not get block locations...) when the file was reopened for reading.

      Attachments

        1. h483_20090819b.patch
          31 kB
          Tsz-wo Sze
        2. h483_20090819.patch
          27 kB
          Tsz-wo Sze
        3. h483_20090818.patch
          36 kB
          Tsz-wo Sze
        4. h483_20090810.patch
          17 kB
          Tsz-wo Sze
        5. h483_20090807b.patch
          8 kB
          Tsz-wo Sze
        6. h483_20090807.patch
          32 kB
          Tsz-wo Sze
        7. h483_20090806.patch
          27 kB
          Tsz-wo Sze
        8. h483_20090731.patch
          24 kB
          Tsz-wo Sze
        9. h483_20090730.patch
          20 kB
          Tsz-wo Sze
        10. h483_20090727.patch
          17 kB
          Tsz-wo Sze
        11. h483_20090717.patch
          17 kB
          Tsz-wo Sze
        12. h483_20090713.patch
          18 kB
          Tsz-wo Sze
        13. h483_20090709.patch
          15 kB
          Tsz-wo Sze

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-521 Create new tests for pipeline

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-849 TestFiDataTransferProtocol2#pipeline_Fi_18 sometimes fails

          • Major - Major loss of function.
          • Closed

          Test - A new unit, integration or system test. HDFS-435 Add orthogonal fault injection mechanism/framework

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-264 Better Datanode DiskOutOfSpaceException handling.

          • Major - Major loss of function.
          • Resolved

          Test - A new unit, integration or system test. HDFS-451 Test DataTransferProtocol with fault injection

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. HDFS-542 Support fault injection tests in Hudson

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: