[SPARK-26453] running spark sql cli is looking for wrong path of hive.metastore.warehouse.dir

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.4.0
• Component/s: Build
• Assignee: Unassigned
• Reporter: anubhav tarar
• Created: 27/Dec/18 09:32
• Updated: 12/Dec/22 18:10
• Resolved: 27/Dec/18 10:44

Description

i started the spark sql cli and run the following sql

spark-sql> create table cars(make varchar(10));

it give me below error

2018-12-27 14:49:39 ERROR RetryingHMSHandler:159 - MetaException(message:file:*/user/hive/warehouse/*cars is not a directory or unable to create one)

Note:i have not specify hive.metastore.warehouse.dir anywhere i just downloaded the latest spark version from offical site and try to execute sql

 

further more metastore info logs is printed the right location,but looking at above error it seems that hive.warehouse.metastore.dir is not pointing to that location

 

*2018-12-27 14:49:36 INFO metastore:291 - Mestastore configuration hive.metastore.warehouse.dir changed from /user/hive/warehouse to file:/home/anubhav/Downloads/spark-2.4.0-bin-hadoop2.7/bin/spark-warehouse*