Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-453

external table metastore and execution codepaths use default FileSystem object instead of using one derived from the supplied path

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 0.4.0
    • Metastore
    • None
    • Reviewed
    • Use FileSystem derived from user supplied path when present instead of default.

    Description

      with fs.default.name set to file:///:

      hive> create external table kvu(key int, val string) location 's3n://data.s3ndemo.hive/kv1.txt'
      FAILED: Error in metadata: java.lang.IllegalArgumentException: Wrong FS: s3n://data.s3ndemo.hive/kv1.txt, expected: file:///

      stack trace:

      at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:322)
      at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem
      .java:52)
      at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.jav
      a:308)
      at org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.jav
      a:462)
      at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:90)
      at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_tabl
      e(HiveMetaStore.java:293)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(Hive
      MetaStoreClient.java:252)
      at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:256)

      Attachments

        1. hive-453.patch.3
          42 kB
          Joydeep Sen Sarma
        2. hive-453.patch.2
          42 kB
          Joydeep Sen Sarma
        3. hive-453.patch.1
          31 kB
          Joydeep Sen Sarma
        4. hive-453.br0.3.4.patch
          48 kB
          Prasad Chakka
        5. hive-453.4.tests.patch
          2 kB
          Prasad Chakka
        6. hive-453.4.patch
          40 kB
          Prasad Chakka

        Activity

          People

            jsensarma Joydeep Sen Sarma
            jsensarma Joydeep Sen Sarma
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: