[FLINK-3304] AvroOutputFormat.setSchema() doesn't work in yarn-cluster mode

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1, 1.0.0
• Fix Version/s: 1.0.0
• Assignee: Kostas Kloudas
• Reporter: Sebastian Klemke
• Created: 29/Jan/16 15:20
• Updated: 16/Feb/16 13:49
• Resolved: 16/Feb/16 13:49

Description

Quoting flink cli (schema and names modified):

"The program finished with the following exception:

User-defined object org.apache.flink.api.java.io.AvroOutputFormat@5f253dfb (org.apache.flink.api.java.io.AvroOutputFormat) contains non-serializable field userDefinedSchema = {"type":"record","name":"Pojo","namespace":"com.example","fields":[

{"name":"id","type":["null","string"],"default":null,"subtype":"objectid"}

],"EntityVersion":"0.1.0"}
org.apache.flink.api.common.operators.util.UserCodeObjectWrapper.<init>(UserCodeObjectWrapper.java:84)
org.apache.flink.api.common.operators.GenericDataSinkBase.<init>(GenericDataSinkBase.java:68)
org.apache.flink.api.java.operators.DataSink.translateToDataFlow(DataSink.java:258)
org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:64)
org.apache.flink.api.java.operators.OperatorTranslation.translateToPlan(OperatorTranslation.java:49)
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:939)
org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:907)
org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:57)
com.example.Tool.main(Tool.java:86)
Shutting down YARN cluster"