Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12152

[SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • HDFS-10285, 3.2.0
    • datanode, namenode
    • None
    • Reviewed

    Description

      This jira to improve the StoragePolicySatisfyWorker#stop sequence of steps to improve the thread interruption and graceful shutdown quickly.

      I have observed that TestDataNodeUUID#testUUIDRegeneration test case is getting timed out frequently. When analyzing, it looks like the below function is always taking 3 secs waiting period. Probably, we could improve the thread interruption sequence so that the thread should finish #run method quickly.

      StoragePolicySatisfyWorker.java
      
        void waitToFinishWorkerThread() {
          try {
            movementTrackerThread.join(3000);
          } catch (InterruptedException ignore) {
            // ignore
          }
        }
      

      Attachments

        1. HDFS-12152-HDFS-10285-01.patch
          2 kB
          Rakesh Radhakrishnan
        2. HDFS-12152-HDFS-10285-02.patch
          3 kB
          Rakesh Radhakrishnan
        3. HDFS-12152-HDFS-10285-03.patch
          3 kB
          Rakesh Radhakrishnan

        Activity

          People

            rakeshr Rakesh Radhakrishnan
            rakeshr Rakesh Radhakrishnan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: