After Mavenizing streaming and getting its testcases to use the MiniMRCluster wrapper (
MAPREDUCE-3169), 4 testcases fail to pass.
Following is an assessment of those failures. Note that the testcases have been tweaked only to set the streaming JAR and yarn as the framework.
(If these issues are unrelated we should create sub-tasks for each one of them).
TestStreamingCombiner, fails because returned counters don't match assertion. However, counters printed in the test output indicate values that would satisfy the assertion. As Tom has indicated it seems MR/YARN are not passing back counter information to the client API.
TestStreamingBadRecords, the job is failing with the following exception
Difficult to troubleshoot because there are not task logs from Mini MR/YARN run.
TestStreamingStatus fails in validateTaskStatus() in the following assertion
TestUlimit fails with
|Assignee||Hitesh Shah [ hitesh ]|
|Status||Open [ 1 ]||Patch Available [ 10002 ]|
|Status||Patch Available [ 10002 ]||Open [ 1 ]|
|Status||Open [ 1 ]||Resolved [ 5 ]|
|Fix Version/s||0.24.0 [ 12317654 ]|
|Resolution||Fixed [ 1 ]|
|Status||Resolved [ 5 ]||Closed [ 6 ]|