Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-11505

Disabling llap cache allocate direct is not honored anymore

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: llap
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      ORC refactorings probably broke something. I disabled cache direct allocation but still I am getting this exception

      Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.compress.zlib.ZlibDecompressor.$$YJP$$init(I)J
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.$$YJP$$init(Native Method)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.init(ZlibDecompressor.java)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.<init>(ZlibDecompressor.java:115)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor$ZlibDirectDecompressor.<init>(ZlibDecompressor.java:358)
      	at org.apache.hadoop.hive.shims.ZeroCopyShims.getDirectDecompressor(ZeroCopyShims.java:114)
      	at org.apache.hadoop.hive.shims.Hadoop23Shims.getDirectDecompressor(Hadoop23Shims.java:975)
      	at org.apache.hadoop.hive.ql.io.orc.ZlibCodec.directDecompress(ZlibCodec.java:128)
      	at org.apache.hadoop.hive.ql.io.orc.ZlibCodec.decompress(ZlibCodec.java:84)
      	at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.decompressChunk(EncodedReaderImpl.java:1128)
      	at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedStream(EncodedReaderImpl.java:780)
      	at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedColumns(EncodedReaderImpl.java:467)
      	at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:355)
      	at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:70)
      	at org.apache.hadoop.hive.common.CallableWithNdc.call(CallableWithNdc.java:37)
      

        Attachments

          Activity

            People

            • Assignee:
              prasanth_j Prasanth Jayachandran
              Reporter:
              prasanth_j Prasanth Jayachandran
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: