Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5749

FsShell forces creation of default filesystem object and incorrectly uses default filesystem in some places

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None

      Description

      i was trying do fs -ls operations on s3n filesystem uris (which was not configured as my default filesystem - the default filesystem was not bought up). these operations failed since they always tried to open the default filesystem (error: ""Bad connection to FS. command aborted."). but the default filesystem is not required in these cases at all.

      the code also shows that the default filesystem is used in certain places (instead of the filesystem of the uri). for instance:

      copy(String argv[], ...) { ...
      Path dst = new Path(dest);
      if (!fs.isDirectory(dst)) {

      there are some other places as well.

      1. hadoop-5749.1.patch
        4 kB
        Joydeep Sen Sarma
      2. hadoop-5749.2.patch
        7 kB
        Joydeep Sen Sarma

        Issue Links

          Activity

          Hide
          tomwhite Tom White added a comment -

          Joydeep, did you manage to chase these down? Was the default filesystem HDFS?

          Show
          tomwhite Tom White added a comment - Joydeep, did you manage to chase these down? Was the default filesystem HDFS?
          Hide
          jsensarma Joydeep Sen Sarma added a comment -

          sorry - i do have a patch for this (but haven't figure the testing part out). will upload something later today.

          Show
          jsensarma Joydeep Sen Sarma added a comment - sorry - i do have a patch for this (but haven't figure the testing part out). will upload something later today.
          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          Joydeep, your patch probably also fix HADOOP-2835.

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - Joydeep, your patch probably also fix HADOOP-2835 .
          Hide
          jsensarma Joydeep Sen Sarma added a comment -

          forgot to add file.

          Show
          jsensarma Joydeep Sen Sarma added a comment - forgot to add file.
          Hide
          tomwhite Tom White added a comment -

          Patch needs regenerating following the project split.

          Show
          tomwhite Tom White added a comment - Patch needs regenerating following the project split.
          Hide
          boryas Boris Shkolnik added a comment -

          this issue is fixed in HADOOP-7207

          Show
          boryas Boris Shkolnik added a comment - this issue is fixed in HADOOP-7207

            People

            • Assignee:
              jsensarma Joydeep Sen Sarma
              Reporter:
              jsensarma Joydeep Sen Sarma
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development