Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-8970

Add more automated end-to-end tests

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      In order to improve Flink's test coverage and make releasing easier, we should add more automated end-to-end tests which test Flink more like a user would interact with the system. Additionally, these end-to-end tests should test the integration of various other systems with Flink.

      With FLINK-6539, we added a new module flink-end-to-end-tests which contains the set of currently available end-to-end tests.

      With FLINK-8911, a script was added to trigger these tests.

       

      This issue is an umbrella issue collecting all different end-to-end tests which we want to add to the Flink repository.

       

      Attachments

        Issue Links

        1.
        Introduce automated end-to-end test for local recovery (including sticky scheduling) Sub-task Closed Stefan Richter   Actions
        2.
        End-to-end test: Run general purpose job with failures in standalone mode Sub-task Resolved Kostas Kloudas   Actions
        3.
        End-to-end test: Run general purpose DataSet job with failures in standalone mode Sub-task Closed Tuo Wang   Actions
        4.
        End-to-end test: Resume from savepoint Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        5.
        End-to-end test: Resume with different parallelism Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        6.
        End-to-end test: Quickstarts Sub-task Closed zhangminglei   Actions
        7.
        End-to-end test: ElasticSearch connector Sub-task Closed zhangminglei   Actions
        8.
        End-to-end test: Manually resume job after terminal failure Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        9.
        End-to-end test: Dynamic Kafka partition discovery Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        10.
        Extend Kafka end-to-end tests to run with different versions Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        11.
        End-to-end test: Stream SQL query with failure and retry Sub-task Resolved Fabian Hueske   Actions
        12.
        End-to-end test: Job upgrade Sub-task Closed Andrey Zagrebin   Actions
        13.
        End-to-end test: BucketingSink Sub-task Resolved Timo Walther   Actions
        14.
        Add end-to-end test for running on YARN with Kerberos Sub-task Closed Aljoscha Krettek   Actions
        15.
        End-to-end test: Queryable state Sub-task Closed Florian Schmidt   Actions
        16.
        End-to-end test: Confluent schema registry Sub-task Closed Yazdan Shirvany   Actions
        17.
        End-to-end test: CLI Sub-task Resolved Rong Rong   Actions
        18.
        End-to-end test: REST Sub-task In Progress Unassigned   Actions
        19.
        End-to-end test: Avro state evolution Sub-task Closed Kostas Kloudas   Actions
        20.
        End-to-end test: Cassandra connector Sub-task Closed Unassigned   Actions
        21.
        End-to-end test: Ganglia metrics reporter Sub-task Open Unassigned   Actions
        22.
        Resume from savepoint end-to-end tests should be extended for different state backends Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        23.
        End-to-end test: Resume from retained checkpoints Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        24.
        End-to-end test: Add test that verifies that a specific classloading issue with avro is fixed Sub-task In Progress Unassigned   Actions
        25.
        Update `test-ha.sh` end-to-end test to use general purpose DataStream job Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        26.
        End-to-end test: Kubernetes integration Sub-task Resolved Dawid Wysakowicz   Actions
        27.
        End-to-end test: Python API Sub-task Closed Chesnay Schepler   Actions
        28.
        Let externalized checkpoint resume e2e also test rescaling Sub-task Resolved Tzu-Li (Gordon) Tai   Actions
        29.
        End-to-end test: Scala Quickstarts Sub-task Closed Yazdan Shirvany   Actions
        30.
        End-to-end test: Flink-Example module [flink-examples-streaming] Sub-task Open Unassigned   Actions
        31.
        End-to-end test: SQL Client with unified source/sink/format Sub-task Resolved Timo Walther   Actions
        32.
        End-to-end test: Streaming job with SSL Sub-task Closed Nico Kruber   Actions
        33.
        End-to-end test: Elasticsearch 6.x connector Sub-task Resolved Tzu-Li (Gordon) Tai   Actions
        34.
        Add end-to-end test for REST communication encryption Sub-task Closed Andrey Zagrebin   Actions
        35.
        Run general purpose test job with failures in per-job mode Sub-task Closed Dawid Wysakowicz   Actions
        36.
        End-to-end test: Prometheus reporter Sub-task Closed Chesnay Schepler   Actions
        37.
        End-to-end test: Metrics accessible via REST API Sub-task Closed Chesnay Schepler   Actions
        38.
        End-to-end test: Take & resume from savepoint when using per-job mode Sub-task Closed Tzu-Li (Gordon) Tai   Actions
        39.
        Add stress deployment end-to-end test Sub-task Closed Stefan Richter   Actions
        40.
        Add S3 entropy injection end-to-end/IT test Sub-task Closed Gary Yao   Actions
        41.
        Modify one of the s3 tests to use the Presto S3 s3p schema Sub-task Closed Stefan Richter   Actions
        42.
        End-to-end test: Kinesis connector Sub-task Resolved Thomas Weise Actions
        43.
        Add end2end stream sql test for unbounded operators Sub-task Open Unassigned   Actions

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            trohrmann Till Rohrmann

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h 20m
                1h 20m

                Slack

                  Issue deployment