Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1605

Convert DFSInputStream synchronized sections to a ReadWrite lock

    Details

    • Type: Improvement Improvement
    • Status: Patch Available
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      Hbase does concurrent preads from multiple threads to different blocks of the same hdfs file. Each of these pread calls invoke DFSInputStream.getFileLength() and DFSInputStream.getBlockAt(). These methods are "synchronized", thus causing all the concurrent threads to serialize. It would help performance to convert this to a Read/Write lock

      1. HDFS-1605.txt
        45 kB
        Liang Xie
      2. DFSClientRWlock.3.txt
        11 kB
        dhruba borthakur
      3. DFSClientRWlock.1.txt
        11 kB
        dhruba borthakur

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              dhruba borthakur
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:

                Development