[HIVE-21005] LLAP: Reading more stripes per-split leaks ZlibCodecs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: llap
• Assignee: Nita Dembla
• Reporter: Gopal Vijayaraghavan
• Created: 05/Dec/18 02:39
• Updated: 17/Nov/22 08:55
• Resolved: 11/Dec/18 18:35

Description

OrcEncodedDataReader - calls ensureDataReader in a loop, overwriting itself

    for (int stripeIxMod = 0; stripeIxMod < stripeRgs.length; ++stripeIxMod) {
....
        // 6.2. Ensure we have stripe metadata. We might have read it before for RG filtering.
        if (stripeMetadatas != null) {
          stripeMetadata = stripeMetadatas.get(stripeIxMod);
        } else {
...
          ensureDataReader();
...
        }

  private void ensureDataReader() throws IOException {
...
    stripeReader = orcReader.encodedReader(
        fileKey, dw, dw, useObjectPools ? POOL_FACTORY : null, trace, useCodecPool, cacheTag);

creates new encodedReader without closing previous stripe's encoded reader.