Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5053

java.lang.InternalError from decompression codec cause reducer to fail

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha, 0.23.5
    • Fix Version/s: 0.23.7, 2.0.4-alpha
    • Component/s: None
    • Labels:
      None

      Description

      lz4, snappy, zlib, and lzo Decompressor's only throw java.lang.InternalError. This exception will cause the reducer to fail and bypass all of the fetch failure logic. The decompressing errors should be treated as fetch failures.

      1. MAPREDUCE-5053-1.patch
        6 kB
        Robert Parker
      2. MAPREDUCE-5053-b023-1.patch
        2 kB
        Robert Parker
      3. MAPREDUCE-5053-2.patch
        6 kB
        Robert Parker

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Robert Parker
            Reporter:
            Robert Parker
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development