[SOLR-15405] Make HDFS handle little endian LUCENE-9047

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 9.0
• Fix Version/s: 9.0
• Component/s: hdfs
• Assignee: Kevin Risden
• Reporter: Gus Heck
• Created: 13/May/21 16:24
• Updated: 12/May/22 00:26
• Resolved: 20/Jan/22 18:34

Description

HDFS tests are failing very frequently and one example that seems to reproduce reliably. One seed that seems to reproduce reliably is 

gradlew :solr:core:test --tests "org.apache.solr.index.hdfs.CheckHdfsIndexTest.testChecksumsOnly" -Ptests.jvms=30 -Ptests.jvmargs=-XX:TieredStopAtLevel=1 -Ptests.seed=566ED88C9109BEFC -Ptests.file.encoding=US-ASCII

This may have been broken due by LUCENE-9047

Marking as a blocker because clearly something isn't working at all here and we shouldn't release broken code. The effort to move the deprecated HDFS code to a package in SOLR-14660 is also relevant

Issue Links

• is related to: SOLR-15943 Simplify HDFS cache to account for LUCENE-10366 / LUCENE-10376
• relates to: LUCENE-9047 Directory APIs should be little endian
• relates to: SOLR-14660 Migrating HDFS into a module
• links to: GitHub Pull Request #127
• links to: GitHub Pull Request #528