Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.2-alpha
    • Fix Version/s: 2.0.3-alpha
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      See discussion in HDFS-744. The actual sync/flush operation in BlockReceiver is not on a synchronous path from the DFSClient, hence it is possible that a DN loses data that it has already acknowledged as persisted to a client.

      Edit: Spelling.

      1. hdfs-3979-sketch.txt
        3 kB
        Lars Hofhansl
      2. hdfs-3979-v2.txt
        2 kB
        Lars Hofhansl
      3. hdfs-3979-v3.txt
        3 kB
        Lars Hofhansl
      4. hdfs-3979-v4.txt
        3 kB
        Lars Hofhansl

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Tsz Wo Nicholas Sze made changes -
          Affects Version/s 2.0.2-alpha [ 12322472 ]
          Affects Version/s 2.0.0-alpha [ 12320353 ]
          Tsz Wo Nicholas Sze made changes -
          Summary Fix hsync and hflush semantics. Fix hsync semantics
          Affects Version/s 0.22.0 [ 12314241 ]
          Affects Version/s 0.23.0 [ 12315571 ]
          Component/s hdfs client [ 12312928 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Resolution Fixed [ 1 ]
          Lars Hofhansl made changes -
          Attachment hdfs-3979-v4.txt [ 12552061 ]
          Lars Hofhansl made changes -
          Link This issue blocks HBASE-5954 [ HBASE-5954 ]
          Lars Hofhansl made changes -
          Link This issue relates to HDFS-4060 [ HDFS-4060 ]
          Lars Hofhansl made changes -
          Attachment hdfs-3979-v3.txt [ 12549002 ]
          Lars Hofhansl made changes -
          Attachment hdfs-3979-v2.txt [ 12547049 ]
          Suresh Srinivas made changes -
          Affects Version/s 2.0.0-alpha [ 12320353 ]
          Affects Version/s 0.23.0 [ 12315571 ]
          Affects Version/s 0.22.0 [ 12314241 ]
          Component/s data-node [ 12312927 ]
          Component/s hdfs client [ 12312928 ]
          Lars Hofhansl made changes -
          Description See discussion in HDFS-744. The actual sync/flush operation in BlockReceiver is not on a synchronous path from the DFSClient, hence it is possible that DN loses data that is has already acknowledged as persisted to a client. See discussion in HDFS-744. The actual sync/flush operation in BlockReceiver is not on a synchronous path from the DFSClient, hence it is possible that a DN loses data that it has already acknowledged as persisted to a client.

          Edit: Spelling.
          Lars Hofhansl made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Lars Hofhansl made changes -
          Attachment hdfs-3979-sketch.txt [ 12546734 ]
          Lars Hofhansl made changes -
          Assignee Lars Hofhansl [ lhofhansl ]
          Lars Hofhansl made changes -
          Field Original Value New Value
          Link This issue is related to HDFS-744 [ HDFS-744 ]
          Lars Hofhansl created issue -

            People

            • Assignee:
              Lars Hofhansl
              Reporter:
              Lars Hofhansl
            • Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development