Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-11505

Disabling llap cache allocate direct is not honored anymore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • llap
    • None
    • None
    • None

    Description

      ORC refactorings probably broke something. I disabled cache direct allocation but still I am getting this exception

      Caused by: java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.compress.zlib.ZlibDecompressor.$$YJP$$init(I)J
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.$$YJP$$init(Native Method)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.init(ZlibDecompressor.java)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.<init>(ZlibDecompressor.java:115)
      	at org.apache.hadoop.io.compress.zlib.ZlibDecompressor$ZlibDirectDecompressor.<init>(ZlibDecompressor.java:358)
      	at org.apache.hadoop.hive.shims.ZeroCopyShims.getDirectDecompressor(ZeroCopyShims.java:114)
      	at org.apache.hadoop.hive.shims.Hadoop23Shims.getDirectDecompressor(Hadoop23Shims.java:975)
      	at org.apache.hadoop.hive.ql.io.orc.ZlibCodec.directDecompress(ZlibCodec.java:128)
      	at org.apache.hadoop.hive.ql.io.orc.ZlibCodec.decompress(ZlibCodec.java:84)
      	at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.decompressChunk(EncodedReaderImpl.java:1128)
      	at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedStream(EncodedReaderImpl.java:780)
      	at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedColumns(EncodedReaderImpl.java:467)
      	at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:355)
      	at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:70)
      	at org.apache.hadoop.hive.common.CallableWithNdc.call(CallableWithNdc.java:37)
      

      Attachments

        Activity

          People

            prasanth_j Prasanth Jayachandran
            prasanth_j Prasanth Jayachandran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: