Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3485

CassandraIO.read() splitting produces invalid queries

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.5.0
    • io-java-cassandra
    • None

    Description

      See https://stackoverflow.com/questions/48090668/how-to-increase-dataflow-read-parallelism-from-cassandra/48131264?noredirect=1#comment83548442_48131264

      As the question author points out, the error is likely that token($pk) should be token(pk). This was likely masked by BEAM-3424 and BEAM-3425, and the splitting code path effectively was never invoked, and was broken from the first PR - so there are likely other bugs.

      When testing this issue, we must ensure good code coverage in an IT against a real Cassandra instance.

      Attachments

        Issue Links

          Activity

            People

              adejanovski Alexander Dejanovski
              jkff Eugene Kirpichov
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 5h 40m
                  5h 40m