Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15132 Über-jira: WASB client phase III: roll-up for Hadoop 3.2
  3. HADOOP-11715

azureFs::getFileStatus doesn't check the file system scheme and thus could throw a misleading exception.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.7.0
    • None
    • fs, fs/azure

    Description

      azureFs::getFileStatus doesn't check the file system scheme and thus could throw a misleading exception.
      For example, it complains filenotfound instead of wrong-fs for an hdfs path:

      Caused by: java.io.FileNotFoundException: hdfs://headnode0:9000/hive/scratch/hadoopqa/a7d34a22-57eb-4678-84b4-43d84027d45f/hive_2015-03-02_23-13-04_713_5722627238053417441-1/hadoopqa/_tez_scratch_dir/_tez_scratch_dir/split_Map_1/job.split: No such file or directory.
      at org.apache.hadoop.fs.azure.NativeAzureFileSystem.getFileStatus(NativeAzureFileSystem.java:1625)

      Attachments

        1. HADOOP-11715.1.patch
          3 kB
          nijel
        2. HADOOP-11715.2.patch
          3 kB
          nijel
        3. HADOOP-11715.3.patch
          3 kB
          nijel

        Activity

          People

            nijel nijel
            brandonli Brandon Li
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: