Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4049

Improve write throughput of CassandraIO

Details

    Description

      The CassandraIO currently uses the mapper to perform writes in a synchronous fashion. 

      This implies that writes are serialized and is a very suboptimal way of writing to Cassandra.

      The IO should use the saveAsync() method instead of save() and should wait for completion each time 100 queries are in flight, in order to avoid overwhelming clusters.

      Attachments

        Issue Links

          Activity

            People

              adejanovski Alexander Dejanovski
              adejanovski Alexander Dejanovski
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 8.5h
                  8.5h