Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-14554

Create BigtableIO setting to report external system throttle time to Dataflow

Details

    • New Feature
    • Status: Triage Needed
    • P2
    • Resolution: Unresolved
    • None
    • None
    • io-java-gcp
    • None

    Description

      Create a setting inside of BigtableConfig to report external system throttle time to Dataflow. This setting will inform Dataflow that the client is throttling and Dataflow will either maintain or decrease workers. 

      This should help with overloading issues on the Bigtable side.

      Attachments

        Activity

          People

            Unassigned Unassigned
            diegomez17 Diego E Gomez
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 0.5h
                0.5h