Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15094

FileSystem.getCanonicalUri() to be public

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.7.4
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None

      Description

      Discussion around SPARK-22587 highlights how per-fs notions of a canonical URI make it hard to determine if a file is on a specific filesystem, or, put differently, if two filesystems are equivalent.

      You can't reliably use this.getUri == that.getUri as it doesn't handle FQDN == unqualified DN, bit you can't do nslookup as HDFS HA doesn't use hosnames.

      If FileSystem.getCanonicalUri() were public, then this could be used to compare things consistently.

      needs: filesystem.md coverage; contract test (two filesystem instances are equal, different filesystems aren't). Or at least: this method never returns null.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: