Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-8968

Erasure coding: a comprehensive I/O throughput benchmark tool

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • erasure-coding, test
    • None
    • Reviewed

    Description

      We need a new benchmark tool to measure the throughput of client writing and reading considering cases or factors:

      • 3-replica or striping;
      • write or read, stateful read or positional read;
      • which erasure coder;
      • striping cell size;
      • concurrent readers/writers using processes or threads.

      The tool should be easy to use and better to avoid unnecessary local environment impact, like local disk.

      Attachments

        1. HDFS-8968-HDFS-7285.2.patch
          14 kB
          Rui Li
        2. HDFS-8968-HDFS-7285.1.patch
          13 kB
          Rui Li
        3. HDFS-8968.5.patch
          19 kB
          Rui Li
        4. HDFS-8968.4.patch
          19 kB
          Rui Li
        5. HDFS-8968.3.patch
          15 kB
          Rui Li

        Activity

          People

            lirui Rui Li
            drankye Kai Zheng
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: