[SOLR-6920] During replication use checksums to verify if files are the same

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 5.0, 6.0
• Component/s: replication (java)
• Assignee: Mark Miller
• Reporter: Varun Thacker
• Created: 07/Jan/15 07:23
• Updated: 21/Nov/19 00:42
• Resolved: 09/Feb/15 18:50

Description

Currently we check if an index file on the master and slave is the same by checking if it's name and file length match.

With LUCENE-2446 we now have a checksums for each index file in the segment. We should leverage this to verify if two files are the same.

Places like SnapPuller.isIndexStale and SnapPuller.downloadIndexFiles should check against the checksum also.

Issue Links

• is depended upon by: SOLR-6640 Replication can cause index corruption.
• is related to: SOLR-7134 Replication can still cause index corruption.
• relates to: SOLR-7093 Cleanup comment and move hardcoded value of file size to replicate to a final