Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7462

Use thread pool to improve the speed of creating control files in TestDFSIO

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 3.3.6
    • None
    • examples, test
    • None

    Description

      When we use TestDFSIO tool to test the throughouts of HDFS clusters, we found it is so slow in the creating controll files stage. 

      After refering to the source code, we found that method createControlFile try to create control files serially. It can be improved by using thread pool.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zhanghaobo farmmamba
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: