Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5053

java.lang.InternalError from decompression codec cause reducer to fail

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha, 0.23.5
    • Fix Version/s: 0.23.7, 2.0.4-alpha
    • Component/s: None
    • Labels:
      None

      Description

      lz4, snappy, zlib, and lzo Decompressor's only throw java.lang.InternalError. This exception will cause the reducer to fail and bypass all of the fetch failure logic. The decompressing errors should be treated as fetch failures.

      1. MAPREDUCE-5053-b023-1.patch
        2 kB
        Robert Parker
      2. MAPREDUCE-5053-2.patch
        6 kB
        Robert Parker
      3. MAPREDUCE-5053-1.patch
        6 kB
        Robert Parker

        Activity

        Allen Wittenauer made changes -
        Affects Version/s trunk [ 12320360 ]
        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320355 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Jonathan Eagles made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Fix Version/s 0.23.7 [ 12323954 ]
        Fix Version/s 2.0.4-alpha [ 12324138 ]
        Resolution Fixed [ 1 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-5053-2.patch [ 12572853 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-5053-b023-1.patch [ 12572852 ]
        Robert Parker made changes -
        Attachment MAPREDUCE-5053-1.patch [ 12572678 ]
        Robert Parker made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Robert Parker created issue -

          People

          • Assignee:
            Robert Parker
            Reporter:
            Robert Parker
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development