Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2533

Remove needless synchronization on FSDataSet.getBlockFile

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1, 1.2.0
    • Component/s: datanode, performance
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      HDFS-1148 discusses lock contention issues in FSDataset. It provides a more comprehensive fix, converting it all to RWLocks, etc. This JIRA is for one very specific fix which gives a decent performance improvement for TestParallelRead: getBlockFile() currently holds the lock which is completely unnecessary.

      1. HDFS-2533.branch-1.patch
        3 kB
        Brandon Li
      2. hdfs-2533.txt
        3 kB
        Todd Lipcon
      3. hdfs-2533.txt
        0.9 kB
        Todd Lipcon

        Activity

        Todd Lipcon created issue -
        Todd Lipcon made changes -
        Field Original Value New Value
        Attachment hdfs-2533.txt [ 12502034 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Todd Lipcon made changes -
        Attachment hdfs-2533.txt [ 12502057 ]
        Todd Lipcon made changes -
        Component/s performance [ 12316501 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.24.0 [ 12317653 ]
        Fix Version/s 0.23.1 [ 12318885 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Brandon Li made changes -
        Attachment HDFS-2533.branch-1.patch [ 12537785 ]
        Tsz Wo Nicholas Sze made changes -
        Fix Version/s 1.2.0 [ 12321657 ]
        Allen Wittenauer made changes -
        Fix Version/s 0.24.0 [ 12317653 ]

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development