[HADOOP-15385] Many tests are failing in hadoop-distcp project in branch-2

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.8.2
• Fix Version/s: 2.10.0, 2.8.4, 2.9.2
• Component/s: tools/distcp
• Target Version/s: 2.10.0, 2.8.4, 2.9.2
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe Assign to me
• Reporter: Rushabh Shah
• Created: 15/Apr/18 23:49
• Updated: 25/Oct/19 20:26
• Resolved: 25/Apr/18 02:17

Description

Many tests are failing in hadoop-distcp project in branch-2.8
Below are the failing tests.

Failed tests: 
  TestDistCpViewFs.testUpdateGlobTargetMissingSingleLevel:326->checkResult:428 expected:<4> but was:<5>
  TestDistCpViewFs.testGlobTargetMissingMultiLevel:346->checkResult:428 expected:<4> but was:<5>
  TestDistCpViewFs.testGlobTargetMissingSingleLevel:306->checkResult:428 expected:<2> but was:<3>
  TestDistCpViewFs.testUpdateGlobTargetMissingMultiLevel:367->checkResult:428 expected:<6> but was:<8>
  TestIntegration.testUpdateGlobTargetMissingSingleLevel:431->checkResult:577 expected:<4> but was:<5>
  TestIntegration.testGlobTargetMissingMultiLevel:454->checkResult:577 expected:<4> but was:<5>
  TestIntegration.testGlobTargetMissingSingleLevel:408->checkResult:577 expected:<2> but was:<3>
  TestIntegration.testUpdateGlobTargetMissingMultiLevel:478->checkResult:577 expected:<6> but was:<8>
  TestIntegration.testUpdateGlobTargetMissingSingleLevel:431->checkResult:577 expected:<4> but was:<5>
  TestIntegration.testGlobTargetMissingMultiLevel:454->checkResult:577 expected:<4> but was:<5>
  TestIntegration.testGlobTargetMissingSingleLevel:408->checkResult:577 expected:<2> but was:<3>
  TestIntegration.testUpdateGlobTargetMissingMultiLevel:478->checkResult:577 expected:<6> but was:<8>
  TestIntegration.testUpdateGlobTargetMissingSingleLevel:431->checkResult:577 expected:<4> but was:<5>
  TestIntegration.testGlobTargetMissingMultiLevel:454->checkResult:577 expected:<4> but was:<5>
  TestIntegration.testGlobTargetMissingSingleLevel:408->checkResult:577 expected:<2> but was:<3>
  TestIntegration.testUpdateGlobTargetMissingMultiLevel:478->checkResult:577 expected:<6> but was:<8>

Tests run: 258, Failures: 16, Errors: 0, Skipped: 0

rushabhs$ pwd
/Users/rushabhs/hadoop/apacheHadoop/hadoop/hadoop-tools/hadoop-distcp

rushabhs$ git branch
 branch-2
  branch-2.7
* branch-2.8
  branch-2.9
  branch-3.0

 rushabhs$ git log --oneline | head -n3
c4ea1c8bb73 HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
1548205a845 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
c01b425ba31 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.

Issue Links

• is broken by: MAPREDUCE-6909 LocalJobRunner fails when run on a node from multiple users