Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-797

TestHDFSCLI much slower after HDFS-265 merge

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.21.0, 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: hdfs-client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      After the merge of HDFS-265 into trunk, TestHDFSCLI takes much longer to run (>10min, got tired of waiting). Changing dataQueue.wait(1000) to dataQueue.wait(10) on line 2708 speeds up the test back to its original performance. This isn't a fix, but displays the issue - somehow the thread isn't getting properly interrupted. In general this probably represents a performance regression for the exit of all HDFS writers (most noticeable in CLI tools)

      1. hdfs-797.txt
        0.7 kB
        Todd Lipcon

        Activity

        Todd Lipcon created issue -
        Todd Lipcon made changes -
        Field Original Value New Value
        Assignee Todd Lipcon [ tlipcon ]
        Todd Lipcon made changes -
        Attachment hdfs-797.txt [ 12426805 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.21.0 [ 12314046 ]
        Fix Version/s 0.22.0 [ 12314241 ]
        Hairong Kuang made changes -
        Hadoop Flags [Reviewed]
        Priority Major [ 3 ] Blocker [ 1 ]
        Konstantin Boudnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Tom White made changes -
        Fix Version/s 0.22.0 [ 12314241 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development