Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-70

Data node should shutdown when a "critical" error is returned by the name node

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently data node does not distinguish between critical and non critical exceptions.
      Any exception is treated as a signal to sleep and then try again. See
      org.apache.hadoop.dfs.DataNode.run()
      This is happening because RPC always throws the same RemoteException.
      In some cases (like UnregisteredDatanodeException, IncorrectVersionException) the data
      node should shutdown rather than retry.
      This logic naturally belongs to the
      org.apache.hadoop.dfs.DataNode.offerService()
      but can be reasonably implemented (without examining the RemoteException.className
      field) after HADOOP-266 (2) is fixed.

        Activity

        Konstantin Shvachko created issue -
        Doug Cutting made changes -
        Field Original Value New Value
        Workflow jira [ 12372673 ] no reopen closed [ 12372962 ]
        Doug Cutting made changes -
        Workflow no reopen closed [ 12372962 ] no-reopen-closed [ 12373294 ]
        Doug Cutting made changes -
        Workflow no-reopen-closed [ 12373294 ] no-reopen-closed, patch-avail [ 12377486 ]
        Doug Cutting made changes -
        Assignee Sameer Paranjpye [ sameerp ]
        Owen O'Malley made changes -
        Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
        Key HADOOP-267 HDFS-70
        Component/s dfs [ 12310710 ]
        Harsh J made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]

          People

          • Assignee:
            Sameer Paranjpye
            Reporter:
            Konstantin Shvachko
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development