Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10682

Replace FsDatasetImpl object lock with a separate lock object

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This Jira proposes to replace the FsDatasetImpl object lock with a separate lock object. Doing so will make it easier to measure lock statistics like lock held time and warn about potential lock contention due to slow disk operations.

      Right now we can use org.apache.hadoop.util.AutoCloseableLock. In the future we can also consider replacing the lock with a read-write lock.

        Attachments

        1. HDFS-10682-branch-2.006.patch
          67 kB
          Chen Liang
        2. HDFS-10682-branch-2.005.patch
          66 kB
          Chen Liang
        3. HDFS-10682-branch-2.004.patch
          64 kB
          Chen Liang
        4. HDFS-10682-branch-2.003.patch
          64 kB
          Chen Liang
        5. HDFS-10682-branch-2.002.patch
          64 kB
          Chen Liang
        6. HDFS-10682-branch-2.001.patch
          64 kB
          Chen Liang
        7. HDFS-10682.010.patch
          68 kB
          Chen Liang
        8. HDFS-10682.009.patch
          69 kB
          Chen Liang
        9. HDFS-10682.008.patch
          70 kB
          Chen Liang
        10. HDFS-10682.007.patch
          70 kB
          Chen Liang
        11. HDFS-10682.006.patch
          63 kB
          Chen Liang
        12. HDFS-10682.005.patch
          115 kB
          Chen Liang
        13. HDFS-10682.004.patch
          115 kB
          Chen Liang
        14. HDFS-10682.003.patch
          114 kB
          Chen Liang
        15. HDFS-10682.002.patch
          114 kB
          Chen Liang
        16. HDFS-10682.001.patch
          115 kB
          Chen Liang

          Issue Links

            Activity

              People

              • Assignee:
                vagarychen Chen Liang
                Reporter:
                vagarychen Chen Liang
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: