Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-8970

Add more automated end-to-end tests

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Tests
    • Labels:
      None

      Description

      In order to improve Flink's test coverage and make releasing easier, we should add more automated end-to-end tests which test Flink more like a user would interact with the system. Additionally, these end-to-end tests should test the integration of various other systems with Flink.

      With FLINK-6539, we added a new module flink-end-to-end-tests which contains the set of currently available end-to-end tests.

      With FLINK-8911, a script was added to trigger these tests.

       

      This issue is an umbrella issue collecting all different end-to-end tests which we want to add to the Flink repository.

       

        Attachments

          Issue Links

          1.
          Introduce automated end-to-end test for local recovery (including sticky scheduling) Sub-task Closed Stefan Richter  
          2.
          End-to-end test: Run general purpose job with failures in standalone mode Sub-task Resolved Kostas Kloudas  
          3.
          End-to-end test: Run general purpose DataSet job with failures in standalone mode Sub-task Closed Tuo Wang  
          4.
          End-to-end test: Resume from savepoint Sub-task Closed Tzu-Li (Gordon) Tai  
          5.
          End-to-end test: Resume with different parallelism Sub-task Closed Tzu-Li (Gordon) Tai  
          6.
          End-to-end test: Quickstarts Sub-task Closed zhangminglei  
          7.
          End-to-end test: ElasticSearch connector Sub-task Closed zhangminglei  
          8.
          End-to-end test: Manually resume job after terminal failure Sub-task Closed Tzu-Li (Gordon) Tai  
          9.
          End-to-end test: Dynamic Kafka partition discovery Sub-task Closed Tzu-Li (Gordon) Tai  
          10.
          Extend Kafka end-to-end tests to run with different versions Sub-task Closed Tzu-Li (Gordon) Tai  
          11.
          End-to-end test: Stream SQL query with failure and retry Sub-task Resolved Fabian Hueske  
          12.
          End-to-end test: Job upgrade Sub-task Closed Andrey Zagrebin  
          13.
          End-to-end test: BucketingSink Sub-task Resolved Timo Walther  
          14.
          Add end-to-end test for running on YARN with Kerberos Sub-task Closed Aljoscha Krettek  
          15.
          End-to-end test: Queryable state Sub-task Closed Florian Schmidt  
          16.
          End-to-end test: Confluent schema registry Sub-task Closed Yazdan Shirvany  
          17.
          End-to-end test: CLI Sub-task Resolved Rong Rong  
          18.
          End-to-end test: REST Sub-task In Progress Rong Rong  
          19.
          End-to-end test: Avro state evolution Sub-task Closed Kostas Kloudas  
          20.
          End-to-end test: Cassandra connector Sub-task Open Shuyi Chen  
          21.
          End-to-end test: Ganglia metrics reporter Sub-task Open Tuo Wang  
          22.
          Resume from savepoint end-to-end tests should be extended for different state backends Sub-task Closed Tzu-Li (Gordon) Tai  
          23.
          End-to-end test: Resume from retained checkpoints Sub-task Closed Tzu-Li (Gordon) Tai  
          24.
          End-to-end test: Add test that verifies that a specific classloading issue with avro is fixed Sub-task In Progress Florian Schmidt  
          25.
          Update `test-ha.sh` end-to-end test to use general purpose DataStream job Sub-task Closed Tzu-Li (Gordon) Tai  
          26.
          End-to-end test: Kubernetes integration Sub-task Resolved Dawid Wysakowicz  
          27.
          End-to-end test: Python API Sub-task Closed Chesnay Schepler  
          28.
          Let externalized checkpoint resume e2e also test rescaling Sub-task Resolved Tzu-Li (Gordon) Tai  
          29.
          End-to-end test: Scala Quickstarts Sub-task Closed Yazdan Shirvany  
          30.
          End-to-end test: Flink-Example module [flink-examples-streaming] Sub-task Open Yazdan Shirvany  
          31.
          End-to-end test: SQL Client with unified source/sink/format Sub-task Resolved Timo Walther  
          32.
          End-to-end test: Streaming job with SSL Sub-task Closed Nico Kruber  
          33.
          End-to-end test: Elasticsearch 6.x connector Sub-task Resolved Tzu-Li (Gordon) Tai  
          34.
          Add end-to-end test for REST communication encryption Sub-task Closed Andrey Zagrebin  
          35.
          Run general purpose test job with failures in per-job mode Sub-task Closed Dawid Wysakowicz  
          36.
          End-to-end test: Prometheus reporter Sub-task Closed Chesnay Schepler  
          37.
          End-to-end test: Metrics accessible via REST API Sub-task Closed Chesnay Schepler  
          38.
          End-to-end test: Take & resume from savepoint when using per-job mode Sub-task Open Tzu-Li (Gordon) Tai  
          39.
          Add stress deployment end-to-end test Sub-task Closed Stefan Richter  
          40.
          Add S3 entropy injection end-to-end/IT test Sub-task Closed Gary Yao  
          41.
          Modify one of the s3 tests to use the Presto S3 s3p schema Sub-task Closed Stefan Richter  
          42.
          End-to-end test: Kinesis connector Sub-task Resolved Thomas Weise
          43.
          Add end2end stream sql test for unbounded operators Sub-task Open Hequn Cheng  

            Activity

              People

              • Assignee:
                yazdanjs Yazdan Shirvany
                Reporter:
                trohrmann Till Rohrmann
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m