[ACCUMULO-4744] Using RFile API with cache and multiple files hides data

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.8.0, 1.8.1
• Fix Version/s: 1.9.0
• Labels: pull-request-available
• Assignee: Keith Turner
• Reporter: Keith Turner
• Created: 20/Nov/17 21:09
• Updated: 23/Apr/19 16:13
• Resolved: 30/Nov/17 20:57

Description

Noticed this bug in source code while working on ACCUMULO-4641. When using the RFile API introduced in 1.8 to read from multiple files with cache enabled, not all data may be seen. This happens because internally the code gives all input sources the same cache id. Therefore index and data blocks from multiple files collide in the cache.

This bug does not happen when reading data through tserver, only the RFile API.

  Scanner scanner =
       RFile.newScanner()
           .from(file1, file2, file3)   //multiple input files
           .withFileSystem(localFs)
           .withIndexCache(1000000)   //enabled cache 
           .withDataCache(10000000)  //enabled cache
           .build();

Issue Links

• links to: GitHub Pull Request #324