Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-11303

New inbound throughput parameters for streaming

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Low
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: Local/Config
    • Labels:
      None

      Description

      Hi,

      To specify stream throughputs of a node more clearly, I would like to add the following new inbound parameters like existing outbound parameters in the cassandra.yaml.

      • stream_throughput_inbound_megabits_per_sec
      • inter_dc_stream_throughput_outbound_megabits_per_sec

      We use only the existing outbound parameters now, but it is difficult to control the total throughputs of a node. In our production network, some critical alerts occurs when a node exceed the specified total throughput which is the sum of the input and output throughputs.

      In our operation of Cassandra, the alerts occurs during the bootstrap or repair processing when a new node is added. In the worst case, we have to stop the operation of the exceed node.

      I have attached the patch under consideration. I would like to add a new limiter class, StreamInboundRateLimiter, and use the limiter class in StreamDeserializer class. I use Row::dataSize( )to get the input throughput in StreamDeserializer::newPartition(), but I am not sure whether the dataSize() returns the correct data size.

      Can someone please tell me how to do it ?

        Attachments

        1. cassandra_inbound_stream.diff
          10 kB
          Satoshi Konno
        2. 200vs40inboundstreamthroughput.png
          42 kB
          Paulo Motta
        3. 11303_inbound_patch_for_trunk_20160704.diff
          32 kB
          Satoshi Konno
        4. 11303_inbound_patch_for_trunk_20160525.diff
          32 kB
          Satoshi Konno
        5. 11303_inbound_patch_for_trunk_20160419.diff
          19 kB
          Satoshi Konno
        6. 11303_inbound_nolimit_debug_20160419.log
          183 kB
          Satoshi Konno
        7. 11303_inbound_limit_debug_20160419.log
          209 kB
          Satoshi Konno

          Issue Links

            Activity

              People

              • Assignee:
                skonno Satoshi Konno
                Reporter:
                skonno Satoshi Konno
                Authors:
                Satoshi Konno
                Reviewers:
                Paulo Motta
              • Votes:
                3 Vote for this issue
                Watchers:
                17 Start watching this issue

                Dates

                • Created:
                  Updated: