[SOLR-12246] Any full recovery complains about checksum mismatch for a .liv file

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Varun Thacker
• Created: 19/Apr/18 18:48
• Updated: 08/Jun/19 15:14

Description

Any time a full recovery happens, I get a failed checksum mismatch on the ".liv" file.

date time WARN  [recoveryExecutor-3-thread-5-processing-x:collection_shard_replica https:////host:port//solr//collection_shard_replica r:core_node69 n:host:port_solr c:collection s:shard] ? (:) - File _2yzfn_7pc.liv did not match. expected checksum is 4263266717 and actual is checksum 1689291857. expected length is 936757 and actual length is 936757

Today we download the file anyways because of this check in IndexFetcher

static boolean filesToAlwaysDownloadIfNoChecksums(String filename,
    long size, CompareResult compareResult) {
  // without checksums to compare, we always download .si, .liv, segments_N,
  // and any very small files
  return !compareResult.checkSummed && (filename.endsWith(".si") || filename.endsWith(".liv")
  || filename.startsWith("segments_") || size < _100K);
}

So I think a WARN here is very confusing to a user who doesn't understand the internals of a full recovery .