[HUDI-3253] preferred to use table's location

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: spark-sql
• Labels: pull-request-available
• Assignee: Yann Byron
• Reporter: Yann Byron

Reviewers

Forward Xu, Raymond Xu

• Created: 15/Jan/22 15:26
• Updated: 29/Jan/22 08:40
• Resolved: 29/Jan/22 08:40

Description

When we create a hudi table with specified location which isn't the subpath of the current database's location, and then turn this table to a managed table, it'll fail to find the right table path.

The steps you can run to reproduce:

 

// create table in SPARK

create table if not exists cow_nonpt_nonpcf_tbl (
  id int,
  name string,
  price double
) using hudi
options (
  type = 'cow',
  primaryKey = 'id'
)
location '/user/hudi/cow_nonpt_nonpcf_tbl';

// turn it to a managed table in HIVE 
alter table cow_nonpt_nonpcf_tbl set tblproperties ('EXTERNAL'='false');

// insert some data in SPARK
insert into cow_nonpt_nonpcf_tbl select 1, 'a1', 20;

// will throw FileNotFoundException

 

 

 

Issue Links

• links to: GitHub Pull Request #4608