[HIVE-21932] IndexOutOfRangeException in FileChksumIterator

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.2.0, 4.0.0-alpha-1
• Assignee: Vihang Karajgaonkar
• Reporter: Vihang Karajgaonkar
• Created: 27/Jun/19 20:40
• Updated: 17/Nov/22 08:50
• Resolved: 28/Jun/19 18:31

Description

According to definition of InsertEventRequestData in hive_metastore.thrift the filesAddedChecksum is a optional field. But the FileChksumIterator does not handle it correctly when a client fires a insert event which does not have file checksums. The issue is that InsertEvent class initializes fileChecksums list to a empty arrayList so the following check will never come into play

result = ReplChangeManager.encodeFileUri(files.get(i), chksums != null ? chksums.get(i) : null,
                subDirs != null ? subDirs.get(i) : null);

The chksums check above should include a !chksums.isEmpty() check as well in the above line.