[SAMZA-2723] Fix Scala 2.11 tests and yarn version for 1.7 release

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.7
• Assignee: Daniel Chen
• Reporter: Daniel Chen
• Created: 28/Feb/22 18:58
• Updated: 01/Mar/22 19:23
• Resolved: 01/Mar/22 19:23

Description

1. Fix yarn version for ./bin/check-all.sh
   1. Symptom: > Task :samza-yarn_2.11:compileTestScala FAILED

Pruning sources from previous analysis, due to incompatible CompileSetup.

/Users/dchen1/code/samza212/samza/samza-yarn/src/test/scala/org/apache/samza/job/yarn/TestSamzaYarnAppMasterLifecycle.scala:57: type ResourceTypeInfo is not a member of package org.apache.hadoop.yarn.api.records

        override def setResourceTypes(types: java.util.List[org.apache.hadoop.yarn.api.records.ResourceTypeInfo]): Unit = ()

1. 1. Reason: we have updated (https://github.com/apache/samza/pull/1557) the yarn version but did not change it in release tests
2. Fix scalate and scala 2.12 version compatibility
   1. We need to update the scala version from 2.12.1 -> 2.12.11 for scalate compatibility
   2. Symptom:Caused by: java.lang.NoSuchMethodError: scala.tools.nsc.symtab.classfile.ClassfileParser$unpickler$.unpickle([BILscala/reflect/internal/Symbols$ClassSymbol;Lscala/reflect/internal/Symbols$ModuleSymbol;Ljava/lang/String;)V

at scala.tools.nsc.symtab.classfile.ClassfileParser.parseAttribute$1(ClassfileParser.scala:847)

at scala.tools.nsc.symtab.classfile.ClassfileParser.$anonfun$parseAttributes$17(ClassfileParser.scala:1039)

at scala.tools.nsc.symtab.classfile.ClassfileParser.parseAttributes(ClassfileParser.scala:1039)

at scala.tools.nsc.symtab.classfile.ClassfileParser.parseClass(ClassfileParser.scala:489)

at scala.tools.nsc.symtab.classfile.ClassfileParser.$anonfun$parse$1(ClassfileParser.scala:156)

at scala.tools.nsc.symtab.classfile.ClassfileParser.parse(ClassfileParser.scala:127)

at scala.tools.nsc.symtab.SymbolLoaders$ClassfileLoader.doComplete(SymbolLoaders.scala:311)

at scala.tools.nsc.symtab.SymbolLoaders$SymbolLoader.complete(SymbolLoaders.scala:213)