[HUDI-4608] Fix upgrade command in Hudi CLI

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Component/s: cli
• Labels: pull-request-available
• Story Points: 1
• Epic Link: Improve Hudi CLI
• Assignee: Ethan Guo
• Reporter: Ethan Guo
• Created: 11/Aug/22 22:46
• Updated: 15/Jun/23 17:03
• Resolved: 22/Aug/22 10:04

Description

Running into the following exception when trying to upgrade the Hudi table from version THREE to FIVE using Hudi CLI, with "upgrade table --toVersion FIVE --sparkMaster local[2]":

22/08/11 15:35:39 INFO UpgradeDowngrade: Attempting to move table from version THREE to FIVE
22/08/11 15:35:39 WARN SparkMain: Failed: Could not upgrade/downgrade table at "/<>/test_table" to version "FIVE".
java.lang.IllegalArgumentException: hoodie.table.name property needs to be specified
    at org.apache.hudi.common.table.HoodieTableConfig.generateChecksum(HoodieTableConfig.java:437)
    at org.apache.hudi.table.upgrade.ThreeToFourUpgradeHandler.upgrade(ThreeToFourUpgradeHandler.java:43)
    at org.apache.hudi.table.upgrade.UpgradeDowngrade.upgrade(UpgradeDowngrade.java:147)
    at org.apache.hudi.table.upgrade.UpgradeDowngrade.run(UpgradeDowngrade.java:118)
    at org.apache.hudi.cli.commands.SparkMain.upgradeOrDowngradeTable(SparkMain.java:520)
    at org.apache.hudi.cli.commands.SparkMain.main(SparkMain.java:271)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
    at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
    at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
    at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
    at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
    at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 

Issue Links

• links to: GitHub Pull Request #6374