Hadoop Common
  1. Hadoop Common
  2. HADOOP-5895

Log message shows -ve number of bytes to be merged in the final merge pass when there are no intermediate merges and merge factor is > number of segments

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Log message shows -ve number of bytes to be merged in the final merge pass when there are no intermediate merges and the mergeFactor is > total number of segments to be merged. This issue is because of code changes done in HADOOP-5572.

      1. HADOOP-5895.v1.patch
        1 kB
        Ravi Gummadi
      2. HADOOP-5895.v1.1.patch
        2 kB
        Ravi Gummadi
      3. HADOOP-5895.patch
        0.5 kB
        Ravi Gummadi

        Activity

        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Robert Chansler made changes -
        Release Note This patch fixes the issue of final merge not getting included in the calculation of estimated bytes in merges in map task when the merge factor is > total number of segments.
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Ravi Gummadi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ravi Gummadi made changes -
        Attachment HADOOP-5895.v1.1.patch [ 12408983 ]
        Ravi Gummadi made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ravi Gummadi made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note This patch fixes the issue of final merge not getting included in the calculation of estimated bytes in merges in map task when the merge factor is > total number of segments.
        Ravi Gummadi made changes -
        Attachment HADOOP-5895.v1.patch [ 12408921 ]
        Ravi Gummadi made changes -
        Summary Log message shows -ve number of bytes to be merged in the final merge pass when there are no intermediate merges and merge factor is < number of segments Log message shows -ve number of bytes to be merged in the final merge pass when there are no intermediate merges and merge factor is > number of segments
        Description Log message shows -ve number of bytes to be merged in the final merge pass when there are no intermediate merges and the mergeFactor is < total number of segments to be merged. This issue is because of code changes done in HADOOP-5572. Log message shows -ve number of bytes to be merged in the final merge pass when there are no intermediate merges and the mergeFactor is > total number of segments to be merged. This issue is because of code changes done in HADOOP-5572.
        Ravi Gummadi made changes -
        Field Original Value New Value
        Attachment HADOOP-5895.patch [ 12408781 ]
        Ravi Gummadi created issue -

          People

          • Assignee:
            Ravi Gummadi
            Reporter:
            Ravi Gummadi
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development