Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19367

Hive metastore temporary configuration doesn't specify default filesystem

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Incomplete
    • Affects Version/s: 1.6.3, 2.0.2, 2.1.0, 2.2.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:

      Description

      When a temporary configuration is obtained in HiveUtils, it specify the warehouse location on the local file system. This is fine, but if the default file system is specified different than local, it may fail due to the lack of required configuration options.

      What I propose here is to set default file system to file:/// in addition to setting warehouse location to local file system.

      Why - because regardless of what file system is accessed by Hive, it does initialisation with the default file system and if it requires some configuration, it will fail.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jlewandowski Jacek Lewandowski
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: