[BEAM-8865] FileIO's Javadoc is outdated: TypeDescriptors.KVs and unhandled IOException

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.19.0
• Component/s: sdk-java-core
• Labels: Done
• Assignee: Tomo Suzuki
• Reporter: Tomo Suzuki
• Created: 02/Dec/19 20:51
• Updated: 06/Oct/20 21:53
• Resolved: 05/Feb/20 03:06

Description

The doc says

However, I had to modify the code to below:

    p.apply("ReadLines",
        FileIO.match().filepattern("hdfs:///foo/bar/*.gz"))
        .apply(FileIO.readMatches().withCompression(GZIP))
        .apply(MapElements
            // uses imports from TypeDescriptors
            .into(kvs(strings(), strings()))
            .via((ReadableFile f) -> {
              try {
                return KV.of(
                    f.getMetadata().resourceId().toString(), f.readFullyAsUTF8String());
              } catch (IOException ex) {
                throw new RuntimeException("Failed to read the file", ex);
              }
             }))

Issue Links

• links to: GitHub Pull Request #10256