Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12053

Harfs defaulturiport should be Zero ( should not -1)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      The harfs overrides the "getUriDefaultPort" method of AbstractFilesystem, and returns "-1" . But "-1" can't pass the "checkPath" method when the fs.defaultfs is setted without port(like hdfs://hacluster)

      Test Code :

      for (FileStatus file : files) {
                String[] edges = file.getPath().getName().split("-");
                if (applicationId.toString().compareTo(edges[0]) >= 0 && applicationId.toString().compareTo(edges[1]) <= 0) {
                  Path harPath = new Path("har://" + file.getPath().toUri().getPath());
                  harPath = harPath.getFileSystem(conf).makeQualified(harPath);
                  remoteAppDir = LogAggregationUtils.getRemoteAppLogDir(
                      harPath, applicationId, appOwner,
                      LogAggregationUtils.getRemoteNodeLogDirSuffix(conf));
                  if (FileContext.getFileContext(remoteAppDir.toUri()).util().exists(remoteAppDir)) {
                      remoteDirSet.add(remoteAppDir);
                  }
      

        Attachments

        1. HADOOP-12053.001.patch
          4 kB
          Gera Shegalov
        2. HADOOP-12053.002.patch
          5 kB
          Gera Shegalov
        3. HADOOP-12053.003.patch
          6 kB
          Gera Shegalov

          Activity

            People

            • Assignee:
              jira.shegalov Gera Shegalov
              Reporter:
              brahmareddy Brahma Reddy Battula
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated: