[HIVE-22207] Tez: SplitGenerator throws NumberFormatException when "dfs.block.size" on cluster is "128m"

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0, 3.1.0
• Fix Version/s: 4.0.0
• Component/s: Hive, Tez
• Assignee: Naresh P R
• Reporter: Praneet Sharma
• Created: 16/Sep/19 04:38
• Updated: 03/Oct/19 04:25
• Resolved: 03/Oct/19 04:25

Description

When the value of "dfs.block.size" on the cluster is "128m" in place of actual bytes as Long, then Tez job fails with NumberFormatException:

java.lang.NumberFormatException: For input string: "128m" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Long.parseLong(Long.java:589) at java.lang.Long.parseLong(Long.java:631) at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1539) at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:194) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:278) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:269)