Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-26793

Flink Cassandra connector performance issue

    XMLWordPrintableJSON

Details

    Description

      A warning is observed during long runs of flink job stating “Insertions into scylla might be suffering. Expect performance problems unless this is resolved.”
      Upon initial analysis - “flink cassandra connector is not keeping instance of mapping manager that is used to convert a pojo to cassandra row. Ideally the mapping manager should have the same life time as cluster and session objects which are also created once when the driver is initialized”
      Reference: https://stackoverflow.com/questions/59203418/cassandra-java-driver-warning

      Attachments

        1. Capture d’écran de 2022-04-14 16-34-59.png
          152 kB
          Etienne Chauchot
        2. Capture d’écran de 2022-04-14 16-35-30.png
          133 kB
          Etienne Chauchot
        3. Capture d’écran de 2022-04-14 16-35-07.png
          192 kB
          Etienne Chauchot
        4. jobmanager_log.txt
          223 kB
          Etienne Chauchot
        5. taskmanager_127.0.1.1_33251-af56fa_log
          164 kB
          Etienne Chauchot

        Issue Links

          Activity

            People

              echauchot Etienne Chauchot
              bumblebee Jay Ghiya
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: