Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5053

java.lang.InternalError from decompression codec cause reducer to fail

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.3-alpha, 0.23.5
    • 0.23.7, 2.0.4-alpha
    • None
    • None

    Description

      lz4, snappy, zlib, and lzo Decompressor's only throw java.lang.InternalError. This exception will cause the reducer to fail and bypass all of the fetch failure logic. The decompressing errors should be treated as fetch failures.

      Attachments

        1. MAPREDUCE-5053-1.patch
          6 kB
          Robert Parker
        2. MAPREDUCE-5053-b023-1.patch
          2 kB
          Robert Parker
        3. MAPREDUCE-5053-2.patch
          6 kB
          Robert Parker

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3196 java.lang.InternalError from decompression codec is fatal to a task during shuffle

          • Major - Major loss of function.
          • Closed

          Activity

            People

              robsparker Robert Parker
              robsparker Robert Parker
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: