[MAPREDUCE-7162] TestEvents#testEvents fails

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.1.2, 3.3.0, 3.2.1
• Component/s: jobhistoryserver, test
• Target Version/s: 3.1.2, 3.3.0, 3.2.1
• Hadoop Flags: Reviewed
• Assignee: Zhaohui Xin
• Reporter: Zhaohui Xin
• Created: 25/Nov/18 08:35
• Updated: 27/Nov/18 16:41
• Resolved: 27/Nov/18 11:03

Description

Mapreduce unit test is broken by https://issues.apache.org/jira/browse/MAPREDUCE-7158 . 

I think we should keep the data consistent to avoid corruption when output, so I roll back the previous code and attach the patch.

Broken location is org.apache.hadoop.mapreduce.jobhistory.TestEvents#testEvents.

org.codehaus.jackson.JsonParseException: Illegal unquoted character ((CTRL-CHAR, code 10)): has to be escaped using backslash to be included in name
at [Source: java.io.DataInputStream@25618e91; line: 23, column: 418]

at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433)
at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521)
at org.codehaus.jackson.impl.JsonParserMinimalBase._throwUnquotedSpace(JsonParserMinimalBase.java:482)
at org.codehaus.jackson.impl.Utf8StreamParser.parseEscapedFieldName(Utf8StreamParser.java:1446)
at org.codehaus.jackson.impl.Utf8StreamParser.parseFieldName(Utf8StreamParser.java:1410)
at org.codehaus.jackson.impl.Utf8StreamParser._parseFieldName(Utf8StreamParser.java:1283)
at org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:495)
at org.apache.avro.io.JsonDecoder.doArrayNext(JsonDecoder.java:367)
at org.apache.avro.io.JsonDecoder.arrayNext(JsonDecoder.java:361)
at org.apache.avro.io.ValidatingDecoder.arrayNext(ValidatingDecoder.java:189)
at org.apache.avro.generic.GenericDatumReader.readArray(GenericDatumReader.java:222)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:153)
at org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:155)
at org.apache.avro.generic.GenericDatumReader.readField(GenericDatumReader.java:193)
at org.apache.avro.generic.GenericDatumReader.readRecord(GenericDatumReader.java:183)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:151)
at org.apache.avro.generic.GenericDatumReader.read(GenericDatumReader.java:142)
at org.apache.hadoop.mapreduce.jobhistory.EventReader.getNextEvent(EventReader.java:101)
at org.apache.hadoop.mapreduce.jobhistory.TestEvents.testEvents(TestEvents.java:177)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:748)

Issue Links

• is broken by: MAPREDUCE-7158 Inefficient Flush Logic in JobHistory EventWriter