Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15037

Encryption Zone operations should not block other RPC calls while retreiving encryption keys.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.10.0
    • Fix Version/s: None
    • Component/s: encryption, namenode
    • Labels:
      None

      Description

      I believe it was an intention to avoid blocking other operations while retrieving keys with holding FSDirectory.dirLock. But in reality all other operations enter first FSNamesystemLock then dirLock. So they are all blocked waiting for the key.
      We see substantial increase in RPC wait time (RpcQueueTimeAvgTime) on NameNode when encryption operations are intermixed with regular workloads.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              shv Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: