[HUDI-4855] Bootstrap table from Deltastreamer cannot be read in Spark

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.12.2
• Component/s: bootstrap
• Labels: pull-request-available
• Story Points: 1
• Epic Link: Improve Bootstrap
• Assignee: Sagar Sumit
• Reporter: Ethan Guo

Reviewers

Sagar Sumit, Shiyan Xu

• Created: 16/Sep/22 05:07
• Updated: 17/Oct/22 15:11
• Resolved: 17/Oct/22 15:11

Description

 

scala> val df = spark.read.format("hudi").load("<bootstrap_table>")
org.apache.hudi.exception.HoodieException: No files found for reading in user provided path.
  at org.apache.hudi.HoodieBootstrapRelation.buildFileIndex(HoodieBootstrapRelation.scala:167)
  at org.apache.hudi.HoodieBootstrapRelation.<init>(HoodieBootstrapRelation.scala:65)
  at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:144)
  at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:68)
  at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:350)
  at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:274)
  at org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:245)
  at scala.Option.getOrElse(Option.scala:189)
  at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:245)
  at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:188)
  ... 47 elided

Issue Links

• relates to: HUDI-4944 The encoded slash (%2F) in partition path is not properly decoded during Spark read
• links to: GitHub Pull Request #6694