[HADOOP-16995] ITestS3AConfiguration proxy tests fail when bucket probes == 0

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Component/s: fs/s3, test
• Assignee: Gabor Bota
• Reporter: Steve Loughran
• Created: 17/Apr/20 13:08
• Updated: 05/Jan/21 14:49
• Resolved: 05/Jan/21 14:49

Description

when bucket probes are disabled, proxy config tests in ITestS3AConfiguration fail because the probes aren't being attempted in initialize()

  <property>
    <name>fs.s3a.bucket.probe</name>
    <value>0</value>
  </property>   

Cause: HADOOP-16711
Fix: call unsetBaseAndBucketOverrides for bucket probe in test conf, then set the probe value to 2 just to be resilient to future default changes.

Issue Links

• is broken by: HADOOP-16711 S3A bucket existence checks to support v2 API and "no checks at all"
• is caused by: HADOOP-17454 [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0