Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1850

DN should transmit absolute failed volume count rather than increments to the NN

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The API added in HDFS-811 for the DN to report volume failures to the NN is "inc(DN)". However the given sequence of events will result in the NN forgetting about reported failed volumes:

      1. DN loses a volume and reports it
      2. NN restarts
      3. DN re-registers to the new NN

      A more robust interface would be to have the DN report the total number of volume failures to the NN each heart beat (the same way other volume state is transmitted).

      1. hdfs-1850-7.patch
        48 kB
        Eli Collins
      2. hdfs-1850-6.patch
        48 kB
        Eli Collins
      3. hdfs-1850-5.patch
        48 kB
        Eli Collins
      4. hdfs-1850-4.patch
        49 kB
        Eli Collins
      5. hdfs-1850-3.patch
        49 kB
        Eli Collins
      6. hdfs-1850-2.patch
        49 kB
        Eli Collins
      7. hdfs-1850-1.patch
        42 kB
        Eli Collins

        Activity

          People

          • Assignee:
            Eli Collins
            Reporter:
            Eli Collins
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development