[ZEPPELIN-5887] Classloader issue when reading Parquet files.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.10.0
• Component/s: flink
• Assignee: Phong Nguyen
• Reporter: Daren Wong
• Created: 06/Mar/23 16:53
• Updated: 08/Mar/23 00:57

Description

I am trying to read a Parquet file into a table in Zeppelin but it fails with `java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration`

Docker setup/Steps to reproduce:

 

docker run -u $(id -u) -p 8080:8080 -p 8081:8081 --rm -v /Users/xxx/Downloads/flink-1.13.6:/opt/flink -v /Users/xxx/Downloads/file.parquet:/opt/flink/data.parquet -e FLINK_HOME=/opt/flink --name zeppelin apache/zeppelin:0.10.0

 

flink-sql-parquet_2.12-1.13.6.jar is added to `/Users/xxx/Downloads/flink-1.13.6`.

I attempted to include the missing dependency by adding `flink-s3-fs-hadoop-1.13.6.jar` to `/Users/xxx/Downloads/flink-1.13.6` which then uncovers more missing dependencies `java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.lib.input.FileInputFormat`