Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5053

java.lang.InternalError from decompression codec cause reducer to fail

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha, 0.23.5
    • Fix Version/s: 0.23.7, 2.0.4-alpha
    • Component/s: None
    • Labels:
      None

      Description

      lz4, snappy, zlib, and lzo Decompressor's only throw java.lang.InternalError. This exception will cause the reducer to fail and bypass all of the fetch failure logic. The decompressing errors should be treated as fetch failures.

        Attachments

        1. MAPREDUCE-5053-b023-1.patch
          2 kB
          Robert Parker
        2. MAPREDUCE-5053-2.patch
          6 kB
          Robert Parker
        3. MAPREDUCE-5053-1.patch
          6 kB
          Robert Parker

          Issue Links

            Activity

              People

              • Assignee:
                robsparker Robert Parker
                Reporter:
                robsparker Robert Parker
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: