Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13603

Warmup NameNode EDEK thread retries continuously if there's an invalid key

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.8.0
    • Fix Version/s: None
    • Component/s: encryption, namenode
    • Labels:
      None

      Description

      https://issues.apache.org/jira/browse/HDFS-9405 adds a background thread to pre-warm EDEK cache. 

      However this fails and retries continuously if key retrieval fails for one encryption zone. In our usecase, we have temporarily removed keys for certain encryption zones.  Currently namenode and kms log is filled up with errors related to background thread retrying warmup for ever .

      The pre-warm thread should

      • Continue to refresh other encryption zones even if it fails for one
      • Should retry only if it fails for all encryption zones, which will be the case when kms is down.

       

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              aajayaraj Antony Jay

              Dates

              • Created:
                Updated:

                Issue deployment