Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8582

Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Add a new option "properties" to the "dfsadmin -reconfig" command to get a list of reconfigurable properties.

    Description

      When running a DN reconfig to hotswap some drives, it spits out this output:

      $ hdfs dfsadmin -reconfig datanode localhost:9023 status
      15/06/09 14:58:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      Reconfiguring status for DataNode[localhost:9023]: started at Tue Jun 09 14:57:37 PDT 2015 and finished at Tue Jun 09 14:57:56 PDT 2015.
      FAILED: Change property rpc.engine.org.apache.hadoop.hdfs.protocolPB.ClientDatanodeProtocolPB
              From: "org.apache.hadoop.ipc.ProtobufRpcEngine"
              To: ""
              Error: Property rpc.engine.org.apache.hadoop.hdfs.protocolPB.ClientDatanodeProtocolPB is not reconfigurable.
      FAILED: Change property mapreduce.client.genericoptionsparser.used
              From: "true"
              To: ""
              Error: Property mapreduce.client.genericoptionsparser.used is not reconfigurable.
      FAILED: Change property rpc.engine.org.apache.hadoop.ipc.ProtocolMetaInfoPB
              From: "org.apache.hadoop.ipc.ProtobufRpcEngine"
              To: ""
              Error: Property rpc.engine.org.apache.hadoop.ipc.ProtocolMetaInfoPB is not reconfigurable.
      SUCCESS: Change property dfs.datanode.data.dir
              From: "file:///data/1/user/dfs"
              To: "file:///data/1/user/dfs,file:///data/2/user/dfs"
      FAILED: Change property dfs.datanode.startup
              From: "REGULAR"
              To: ""
              Error: Property dfs.datanode.startup is not reconfigurable.
      FAILED: Change property rpc.engine.org.apache.hadoop.hdfs.protocolPB.InterDatanodeProtocolPB
              From: "org.apache.hadoop.ipc.ProtobufRpcEngine"
              To: ""
              Error: Property rpc.engine.org.apache.hadoop.hdfs.protocolPB.InterDatanodeProtocolPB is not reconfigurable.
      FAILED: Change property rpc.engine.org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolPB
              From: "org.apache.hadoop.ipc.ProtobufRpcEngine"
              To: ""
              Error: Property rpc.engine.org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolPB is not reconfigurable.
      FAILED: Change property rpc.engine.org.apache.hadoop.tracing.TraceAdminProtocolPB
              From: "org.apache.hadoop.ipc.ProtobufRpcEngine"
              To: ""
              Error: Property rpc.engine.org.apache.hadoop.tracing.TraceAdminProtocolPB is not reconfigurable.
      

      These failed messages are spurious and should not be shown.

      Attachments

        1. HDFS-8582.004.patch
          25 kB
          Lei (Eddy) Xu
        2. HDFS-8582.003.patch
          24 kB
          Lei (Eddy) Xu
        3. HDFS-8582.002.patch
          22 kB
          Lei (Eddy) Xu
        4. HDFS-8582.001.patch
          21 kB
          Lei (Eddy) Xu
        5. HDFS-8582.000.patch
          7 kB
          Lei (Eddy) Xu

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            eddyxu Lei (Eddy) Xu Assign to me
            eddyxu Lei (Eddy) Xu
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment