Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
2.6.2, 2.7.3
Description
- Install cluster with Ambari- 2.6.2.26 + HDP-2.6.5.3006
- Set abfs protocol for mapreduce.application.framework.path/fs.defaultFS/tez.lib.uris properties.
- Disable Service Auto Start
- Register and Install stack HDP-2.6.5.3009
- Run preupgrade checks. They fail with
MapReduce should reference Hadoop libraries from the distributed cache in HDFS Reason: The mapred-site.xml property mapreduce.application.framework.path or the core-site.xml property fs.defaultFS should point to *dfs:/ url. Failed on: MAPREDUCE2 Tez should reference Hadoop libraries from the distributed cache in HDFS Reason: The tez-site.xml property tez.lib.uris or the core-site.xml property fs.defaultFS should point to *dfs:/ url. Failed on: TEZ
For ABFS, fs.defaultFS is
abfs://<hostname>
Not seeing this issue for WASB where the value was
wasb://<hostname>
Also, we need to check if there are other places where we have this check, that will break too