Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-453

external table metastore and execution codepaths use default FileSystem object instead of using one derived from the supplied path

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: Metastore
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Use FileSystem derived from user supplied path when present instead of default.

      Description

      with fs.default.name set to file:///:

      hive> create external table kvu(key int, val string) location 's3n://data.s3ndemo.hive/kv1.txt'
      FAILED: Error in metadata: java.lang.IllegalArgumentException: Wrong FS: s3n://data.s3ndemo.hive/kv1.txt, expected: file:///

      stack trace:

      at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
      at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem
      .java:52)
      at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
      a:308)
      at org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.jav
      a:462)
      at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:90)
      at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_tabl
      e(HiveMetaStore.java:293)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(Hive
      MetaStoreClient.java:252)
      at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:256)

        Attachments

        1. hive-453.4.tests.patch
          2 kB
          Prasad Chakka
        2. hive-453.br0.3.4.patch
          48 kB
          Prasad Chakka
        3. hive-453.4.patch
          40 kB
          Prasad Chakka
        4. hive-453.patch.3
          42 kB
          Joydeep Sen Sarma
        5. hive-453.patch.2
          42 kB
          Joydeep Sen Sarma
        6. hive-453.patch.1
          31 kB
          Joydeep Sen Sarma

          Activity

            People

            • Assignee:
              jsensarma Joydeep Sen Sarma
              Reporter:
              jsensarma Joydeep Sen Sarma
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: