Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7398

Improve TestDFSIO to support different filesystem

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 3.3.3
    • None
    • benchmarks

    Description

      TestDFSIO is the tool used for performance benchmarking on Distributed File System. Recently there is a support added for different file system in HDFS. Ex: s3:// (from Amazon), oci:// (from oracle).

       

      Request is to improve the TestDFSIO code to support newly added filesystem so that it can be used for benchmarking IOPS and Throughput of those filesystems. 

      Attachments

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HADOOP-17461 Add thread-level IOStatistics Context

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-16854 TestDFSIO to support non-default file system

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #4604

          Activity

            People

              gvijay452 Vijayakumar Govindasamy
              gvijay452 Vijayakumar Govindasamy
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m