Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2005 Add a Hadoop FileSystem implementation of Beam's FileSystem
  3. BEAM-2031

Hadoop FileSystem needs to receive Hadoop Configuration

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.0.0
    • io-java-hadoop-file-system
    • None

    Description

      Since Beam FileSystem objects are configured via PipelineOptions, we need to pass a Hadoop Configuration through PipelineOptions. I think that's very solvable, but it does seem semi-complicated.

      cc peihe0@gmail.com I believe you mentioned in the past that you had an answer to this - is that written down anywhere?

      Attachments

        Activity

          People

            lcwik Luke Cwik
            sisk Stephen Sisk
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: