Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-17532

Yarn Job execution get failed when LZ4 Compression Codec is used

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.1, 3.4.0
    • common
    • None
    • Reviewed

    Description

      When we try to compress a file using the LZ4 codec compression type then the yarn job gets failed with the error message :

      net.jpountz.lz4.LZ4Compressorcompres(Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)V
      

      Attachments

        1. lz4-test.jpg
          843 kB
          Bhavik Patel
        2. LZ4.png
          298 kB
          Bhavik Patel
        3. HADOOP-17532.002.patch
          0.5 kB
          Bhavik Patel
        4. HADOOP-17532.001.patch
          1.0 kB
          Bhavik Patel

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bpatel Bhavik Patel
            bpatel Bhavik Patel
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment