Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12152

[SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-10285, 3.2.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      This jira to improve the StoragePolicySatisfyWorker#stop sequence of steps to improve the thread interruption and graceful shutdown quickly.

      I have observed that TestDataNodeUUID#testUUIDRegeneration test case is getting timed out frequently. When analyzing, it looks like the below function is always taking 3 secs waiting period. Probably, we could improve the thread interruption sequence so that the thread should finish #run method quickly.

      StoragePolicySatisfyWorker.java
      
        void waitToFinishWorkerThread() {
          try {
            movementTrackerThread.join(3000);
          } catch (InterruptedException ignore) {
            // ignore
          }
        }
      

        Attachments

        1. HDFS-12152-HDFS-10285-01.patch
          2 kB
          Rakesh R
        2. HDFS-12152-HDFS-10285-02.patch
          3 kB
          Rakesh R
        3. HDFS-12152-HDFS-10285-03.patch
          3 kB
          Rakesh R

          Activity

            People

            • Assignee:
              rakeshr Rakesh R
              Reporter:
              rakeshr Rakesh R
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: