[FLINK-24027] FileSystems list excessive dependencies in NOTICE

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Component/s: Connectors / FileSystem
• Labels: pull-request-available
• Assignee: Ingo Bürk
• Reporter: Chesnay Schepler
• Created: 27/Aug/21 11:06
• Updated: 30/Aug/21 10:09
• Resolved: 30/Aug/21 10:09

Description

The LicenseChecker finds several dependencies that are listed in the NOTICE but do not show up in the shade-plugin output. It could be that after the recent AWS/Hadoop bumps these are no longer being bundled (needs confirmation!).

17:05:14,651 WARN  NoticeFileChecker [] - Dependency com.fasterxml.jackson.core:jackson-annotations:2.12.1 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-azure-fs-hadoop/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,651 WARN  NoticeFileChecker [] - Dependency com.fasterxml.jackson.core:jackson-databind:2.12.1 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-azure-fs-hadoop/src/main/resources/META-INF/NOTICE, but is not expected there

17:05:14,652 WARN  NoticeFileChecker [] - Dependency org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:1.1.1 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,652 WARN  NoticeFileChecker [] - Dependency org.apache.hadoop.thirdparty:hadoop-shaded-guava:1.1.1 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,652 WARN  NoticeFileChecker [] - Dependency org.wildfly.openssl:wildfly-openssl:1.0.7.Final is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,652 WARN  NoticeFileChecker [] - Dependency commons-lang:commons-lang:2.6 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE, but is not expected there

17:05:14,741 WARN  NoticeFileChecker [] - Dependency commons-lang:commons-lang:2.6 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-fs-hadoop-shaded/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,743 WARN  NoticeFileChecker [] - Dependency org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:1.1.1 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,743 WARN  NoticeFileChecker [] - Dependency org.apache.hadoop.thirdparty:hadoop-shaded-guava:1.1.1 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,743 WARN  NoticeFileChecker [] - Dependency org.wildfly.openssl:wildfly-openssl:1.0.7.Final is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE, but is not expected there
17:05:14,743 WARN  NoticeFileChecker [] - Dependency commons-lang:commons-lang:2.6 is mentioned in NOTICE file /__w/1/s/flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE, but is not expected there

Issue Links

• is duplicated by: FLINK-24028 NoticeFileChecker complains about dependencies being mentioned in NOTICE file but are not listed in the Maven output
• links to: GitHub Pull Request #17047