[SPARK-34925] Spark shell failed to access external file to read content

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.0.0
• Component/s: Spark Shell
• Assignee: Unassigned
• Reporter: czh
• Created: 01/Apr/21 01:39
• Updated: 12/Dec/22 18:11
• Resolved: 04/Apr/21 03:16

Description

Spark shell failed to access external file to read content

Spark version 3.0, Hadoop version 3.2

Start spark normally, enter spark shell and enter Val B1= sc.textFile ("S3a: / / spark test / a.txt") is normal. When entering B1. Collect(). Foreach (println) to traverse and read the contents of the file, an error is reported

The error message is: java.lang.NumberFormatException : For input string: "100M"