Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8719

Erasure Coding: client generates too many small packets when writing parity data

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      Typically a packet is about 64K, but when writing parity data, many small packets with size 512 bytes are generated. This may slow the write speed and increase the network IO.

      Attachments

        1. HDFS-8719-001.patch
          1 kB
          Li Bo
        2. HDFS-8719-HDFS-7285-001.patch
          2 kB
          Li Bo
        3. HDFS-8719-HDFS-7285-002.patch
          2 kB
          Li Bo
        4. HDFS-8719-HDFS-7285-003.patch
          1 kB
          Li Bo

        Activity

          People

            libo-intel Li Bo
            libo-intel Li Bo
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: