Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8889

Make GcsUtil use GoogleCloudStorage

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • 2.16.0
    • 2.22.0
    • io-java-gcp

    Description

      GcsUtil is a primary class to access Google Cloud Storage on Apache Beam. Current implementation directly creates GoogleCloudStorageReadChannel and GoogleCloudStorageWriteChannel by itself to read and write GCS data rather than using GoogleCloudStorage which is an abstract class providing basic IO capability which eventually creates channel objects. This request is about updating GcsUtil to use GoogleCloudStorage to create read and write channel, which is expected flexible because it can easily pick up the new change; e.g. new channel implementation using new protocol without code change.

      Attachments

        Activity

          People

            vnorigoog VASU NORI
            veblush Esun Kim
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Time Spent - 44h 10m Remaining Estimate - 123h 50m
                123h 50m
                Logged:
                Time Spent - 44h 10m Remaining Estimate - 123h 50m
                44h 10m