Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-25236

Host Ordered Upgrade: Pre Upgrade check of fs.defaultFS fails for ABFS

    XMLWordPrintableJSON

    Details

      Description

      1. Install cluster with Ambari- 2.6.2.26 + HDP-2.6.5.3006
      2. Set abfs protocol for mapreduce.application.framework.path/fs.defaultFS/tez.lib.uris properties.
      3. Disable Service Auto Start
      4. Register and Install stack HDP-2.6.5.3009
      5. Run preupgrade checks. They fail with
        MapReduce should reference Hadoop libraries from the distributed cache in HDFS
        Reason: The mapred-site.xml property mapreduce.application.framework.path or the core-site.xml property fs.defaultFS should point to *dfs:/ url.
        Failed on: MAPREDUCE2 Tez should reference Hadoop libraries from the distributed cache in HDFS
        Reason: The tez-site.xml property tez.lib.uris or the core-site.xml property fs.defaultFS should point to *dfs:/ url.
        Failed on: TEZ
        

        For ABFS, fs.defaultFS is

        abfs://<hostname>
        

        Not seeing this issue for WASB where the value was

        wasb://<hostname>
        

        Also, we need to check if there are other places where we have this check, that will break too

        Attachments

          Activity

            People

            • Assignee:
              mpapirkovskyy Papirkovskyy Myroslav
              Reporter:
              mpapirkovskyy Papirkovskyy Myroslav
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 50m
                1h 50m