[SPARK-34912] Start spark shell to read file and report an error

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 1.6.0
• Component/s: Spark Shell
• Assignee: Unassigned
• Reporter: czh
• Created: 31/Mar/21 02:36
• Updated: 31/Mar/21 15:24
• Resolved: 31/Mar/21 15:24

Description

Start spark shell to read external file and report an error

 

Class org.apache.hadoop .fs.s3a.S3AFileSystem not found

 

Spark version 1.6 and Hadoop version 2.6.0 have copied aws-java-sdk-1.7.4.jar and hadoop-aws-2.6.0.jar to the Lib package under spark

Issue Links

• is duplicated by: SPARK-34913 Start spark shell to read file and report an error