Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8719

Erasure Coding: client generates too many small packets when writing parity data

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-7285
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Typically a packet is about 64K, but when writing parity data, many small packets with size 512 bytes are generated. This may slow the write speed and increase the network IO.

        Attachments

        1. HDFS-8719-001.patch
          1 kB
          Li Bo
        2. HDFS-8719-HDFS-7285-001.patch
          2 kB
          Li Bo
        3. HDFS-8719-HDFS-7285-002.patch
          2 kB
          Li Bo
        4. HDFS-8719-HDFS-7285-003.patch
          1 kB
          Li Bo

          Activity

            People

            • Assignee:
              libo-intel Li Bo
              Reporter:
              libo-intel Li Bo
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: