Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21316

E2E tests exceed 250 minutes.

    XMLWordPrintableJSON

Details

    Description

      "Building Flink : E2E Tests : Metrics availability 1.13-SNAPSHOT " failed because the e2e tests exceed 250 minutes.

      We might need to increase the timeout time of e2e test if this always happens.

       

       

      2021-02-06T21:44:49.0181470Z Feb 06 21:44:49 Running 'Resuming Savepoint (file, async, no parallelism change) end-to-end test'
2021-02-06T21:45:30.5575249Z Feb 06 21:45:30 Running 'Resuming Savepoint (file, sync, no parallelism change) end-to-end test'
2021-02-06T21:46:08.7665664Z Feb 06 21:46:08 Running 'Resuming Savepoint (file, async, scale up) end-to-end test'
2021-02-06T21:46:46.5367199Z Feb 06 21:46:46 Running 'Resuming Savepoint (file, sync, scale up) end-to-end test'
2021-02-06T21:47:25.5898891Z Feb 06 21:47:25 Running 'Resuming Savepoint (file, async, scale down) end-to-end test'
2021-02-06T21:48:06.5943517Z Feb 06 21:48:06 Running 'Resuming Savepoint (file, sync, scale down) end-to-end test'
2021-02-06T21:48:43.9893766Z Feb 06 21:48:43 Running 'Resuming Savepoint (rocks, no parallelism change, heap timers) end-to-end test'
2021-02-06T21:49:25.2329921Z Feb 06 21:49:25 Running 'Resuming Savepoint (rocks, scale up, heap timers) end-to-end test'
2021-02-06T21:50:20.2141503Z Feb 06 21:50:20 Running 'Resuming Savepoint (rocks, scale down, heap timers) end-to-end test'
2021-02-06T21:51:05.8740024Z Feb 06 21:51:05 Running 'Resuming Savepoint (rocks, no parallelism change, rocks timers) end-to-end test'
2021-02-06T21:51:49.8304880Z Feb 06 21:51:49 Running 'Resuming Savepoint (rocks, scale up, rocks timers) end-to-end test'
2021-02-06T21:52:36.8922000Z Feb 06 21:52:36 Running 'Resuming Savepoint (rocks, scale down, rocks timers) end-to-end test'
2021-02-06T21:53:23.8814724Z Feb 06 21:53:22 Running 'Resuming Externalized Checkpoint (file, async, no parallelism change) end-to-end test'
2021-02-06T21:53:56.9471744Z Feb 06 21:53:56 Running 'Resuming Externalized Checkpoint (file, sync, no parallelism change) end-to-end test'
2021-02-06T21:54:33.7412488Z Feb 06 21:54:33 Running 'Resuming Externalized Checkpoint (file, async, scale up) end-to-end test'
2021-02-06T21:55:10.0398250Z Feb 06 21:55:10 Running 'Resuming Externalized Checkpoint (file, sync, scale up) end-to-end test'
2021-02-06T21:55:42.6777298Z Feb 06 21:55:42 Running 'Resuming Externalized Checkpoint (file, async, scale down) end-to-end test'
2021-02-06T21:56:20.3027202Z Feb 06 21:56:20 Running 'Resuming Externalized Checkpoint (file, sync, scale down) end-to-end test'
2021-02-06T21:56:54.5734563Z Feb 06 21:56:54 Running 'Resuming Externalized Checkpoint (rocks, non-incremental, no parallelism change) end-to-end test'
2021-02-06T21:57:31.4779632Z Feb 06 21:57:31 Running 'Resuming Externalized Checkpoint (rocks, incremental, no parallelism change) end-to-end test'
2021-02-06T21:58:08.4279624Z Feb 06 21:58:08 Running 'Resuming Externalized Checkpoint (rocks, non-incremental, scale up) end-to-end test'
2021-02-06T21:58:54.6282132Z Feb 06 21:58:54 Running 'Resuming Externalized Checkpoint (rocks, incremental, scale up) end-to-end test'
2021-02-06T21:59:42.1648621Z Feb 06 21:59:41 Running 'Resuming Externalized Checkpoint (rocks, non-incremental, scale down) end-to-end test'
2021-02-06T22:00:24.1945879Z Feb 06 22:00:23 Running 'Resuming Externalized Checkpoint (rocks, incremental, scale down) end-to-end test'
2021-02-06T22:01:11.5602130Z Feb 06 22:01:11 Running 'Resuming Externalized Checkpoint after terminal failure (file, async) end-to-end test'
2021-02-06T22:01:41.4454645Z Feb 06 22:01:41 Running 'Resuming Externalized Checkpoint after terminal failure (file, sync) end-to-end test'
2021-02-06T22:02:10.6468091Z Feb 06 22:02:10 Running 'Resuming Externalized Checkpoint after terminal failure (rocks, non-incremental) end-to-end test'
2021-02-06T22:02:44.9759168Z Feb 06 22:02:44 Running 'Resuming Externalized Checkpoint after terminal failure (rocks, incremental) end-to-end test'
2021-02-06T22:03:15.6724166Z Feb 06 22:03:15 Running 'RocksDB Memory Management end-to-end test'
2021-02-06T22:07:29.0256715Z Feb 06 22:07:29 Running 'Wordcount on Docker test (custom fs plugin)'
2021-02-06T22:09:07.7990086Z Feb 06 22:09:07 Running 'Run Kubernetes test'
2021-02-06T22:11:50.8878920Z Feb 06 22:11:50 Running 'Run kubernetes session test (default input)'
2021-02-06T22:14:17.4996118Z Feb 06 22:14:17 Running 'Run kubernetes session test (custom fs plugin)'
2021-02-06T22:16:39.6413349Z Feb 06 22:16:39 Running 'Run kubernetes application test'
2021-02-06T22:19:07.7162598Z Feb 06 22:19:07 Running 'Run Kubernetes IT test'
2021-02-06T22:21:47.1083343Z Feb 06 22:21:46 Running 'Running Flink over NAT end-to-end test'
2021-02-06T22:23:25.0104890Z Feb 06 22:23:25 Running 'Run kubernetes pyflink application test'
2021-02-06T22:36:46.4750842Z Feb 06 22:36:46 Running 'Running Kerberized YARN per-job on Docker test (default input)'
2021-02-06T22:45:59.4011603Z Feb 06 22:45:59 Running 'Running Kerberized YARN per-job on Docker test (custom fs plugin)'
2021-02-06T22:50:58.5610556Z Feb 06 22:50:58 Running 'Running Kerberized YARN application on Docker test (default input)'
2021-02-06T22:56:25.1563211Z Feb 06 22:56:25 Running 'Running Kerberized YARN application on Docker test (custom fs plugin)'
2021-02-06T23:01:47.1247852Z Feb 06 23:01:47 Running 'Run Mesos WordCount test'
2021-02-06T23:04:11.2125124Z Feb 06 23:04:11 Running 'Run Mesos multiple submission test'
2021-02-06T23:05:18.5391057Z Feb 06 23:05:18 Running 'Test PubSub connector with Docker based Google PubSub Emulator'
2021-02-06T23:08:18.4473515Z Feb 06 23:08:18 Running 'Running HA dataset end-to-end test'
2021-02-06T23:10:55.0183652Z Feb 06 23:10:55 Running 'Running HA (file, async) end-to-end test'
2021-02-06T23:15:50.1847342Z Feb 06 23:15:50 Running 'Running HA (file, sync) end-to-end test'
2021-02-06T23:20:41.9296312Z Feb 06 23:20:41 Running 'Running HA (rocks, non-incremental) end-to-end test'
2021-02-06T23:26:50.2953704Z Feb 06 23:26:50 Running 'Running HA (rocks, incremental) end-to-end test'
2021-02-06T23:32:57.6164047Z Feb 06 23:32:57 Running 'Running HA per-job cluster (file, async) end-to-end test'
2021-02-06T23:35:44.2525972Z Feb 06 23:35:44 Running 'Running HA per-job cluster (file, sync) end-to-end test'
2021-02-06T23:39:32.7871565Z Feb 06 23:39:32 Running 'Running HA per-job cluster (rocks, non-incremental) end-to-end test'
2021-02-06T23:46:26.3469910Z Feb 06 23:46:26 Running 'Running HA per-job cluster (rocks, incremental) end-to-end test'
2021-02-06T23:49:29.2206298Z Feb 06 23:49:29 Running 'Flink CLI end-to-end test'
2021-02-06T23:50:25.7449268Z Feb 06 23:50:25 Running 'Queryable state (rocksdb) end-to-end test'
2021-02-06T23:53:50.8964294Z Feb 06 23:53:50 Running 'Queryable state (rocksdb) with TM restart end-to-end test'
2021-02-06T23:54:47.9157418Z Feb 06 23:54:47 Running 'DataSet allround end-to-end test'
2021-02-06T23:58:24.4672044Z Feb 06 23:58:23 Running 'Batch SQL end-to-end test'
2021-02-06T23:58:47.9796269Z Feb 06 23:58:47 Running 'Streaming SQL end-to-end test (Old planner)'
2021-02-07T00:00:42.7645484Z Feb 07 00:00:42 Running 'Streaming SQL end-to-end test (Blink planner)'
2021-02-07T00:02:38.4618795Z Feb 07 00:02:38 Running 'Streaming File Sink end-to-end test'
2021-02-07T00:07:02.2046975Z Feb 07 00:07:02 Running 'Streaming File Sink s3 end-to-end test'
2021-02-07T00:12:54.0987141Z Feb 07 00:12:54 Running 'New File Sink end-to-end test'
2021-02-07T00:16:28.5121248Z Feb 07 00:16:28 Running 'New File Sink s3 end-to-end test'
2021-02-07T00:21:40.4811263Z Feb 07 00:21:40 Running 'Stateful stream job upgrade end-to-end test'
2021-02-07T00:22:12.5653071Z Feb 07 00:22:12 Running 'Netty shuffle direct memory consumption end-to-end test'
2021-02-07T00:24:56.9623385Z Feb 07 00:24:56 Running 'Elasticsearch (v5.3.3) sink end-to-end test'
2021-02-07T00:25:32.7402086Z Feb 07 00:25:32 Running 'Elasticsearch (v6.3.1) sink end-to-end test'
2021-02-07T00:26:15.9132836Z Feb 07 00:26:15 Running 'Quickstarts Java nightly end-to-end test'
2021-02-07T00:27:02.6363900Z Feb 07 00:27:02 Running 'Quickstarts Scala nightly end-to-end test'
2021-02-07T00:27:53.6167894Z Feb 07 00:27:53 Running 'Walkthrough DataStream Java nightly end-to-end test'
2021-02-07T00:28:22.0838339Z Feb 07 00:28:22 Running 'Walkthrough DataStream Scala nightly end-to-end test'
2021-02-07T00:28:57.8279216Z Feb 07 00:28:57 Running 'Avro Confluent Schema Registry nightly end-to-end test'
2021-02-07T00:30:18.9213503Z Feb 07 00:30:18 Running 'State TTL Heap backend end-to-end test'
2021-02-07T00:31:18.4416050Z Feb 07 00:31:18 Running 'State TTL RocksDb backend end-to-end test'
2021-02-07T00:32:31.8486718Z Feb 07 00:32:31 Running 'SQL Client end-to-end test (Old planner) Elasticsearch (v7.5.1)'
2021-02-07T00:34:26.6584196Z Feb 07 00:34:26 Running 'SQL Client end-to-end test (Blink planner) Elasticsearch (v7.5.1)'
2021-02-07T00:36:22.8234805Z Feb 07 00:36:22 Running 'TPC-H end-to-end test (Blink planner)'
2021-02-07T00:40:23.8920454Z Feb 07 00:40:23 Running 'TPC-DS end-to-end test (Blink planner)'
2021-02-07T01:00:25.9053248Z Feb 07 01:00:25 Running 'Heavy deployment end-to-end test'
2021-02-07T01:01:42.8990314Z Feb 07 01:01:42 Running 'ConnectedComponents iterations with high parallelism end-to-end test'
2021-02-07T01:02:17.1089660Z Feb 07 01:02:17 Running 'Dependency shading of table modules test'
2021-02-07T01:03:30.0922594Z Feb 07 01:03:30 Running 'Shaded Hadoop S3A with credentials provider end-to-end test'
2021-02-07T01:04:02.9047271Z Feb 07 01:04:02 Running 'PyFlink end-to-end test'
2021-02-07T01:16:32.1249848Z Feb 07 01:16:32 Running 'PyFlink YARN per-job on Docker test'
2021-02-07T01:32:09.3887841Z Feb 07 01:32:09 Running 'Local recovery and sticky scheduling end-to-end test'
2021-02-07T01:33:25.8403502Z Feb 07 01:33:25 Running 'Local recovery and sticky scheduling end-to-end test'
2021-02-07T01:35:47.1659525Z Feb 07 01:35:47 Running 'Local recovery and sticky scheduling end-to-end test'
2021-02-07T01:39:25.2852904Z Feb 07 01:39:25 Running 'Local recovery and sticky scheduling end-to-end test'
2021-02-07T01:41:28.4124370Z Feb 07 01:41:28 Running 'Local recovery and sticky scheduling end-to-end test'
2021-02-07T01:47:47.4170150Z Feb 07 01:47:47 Running 'Local recovery and sticky scheduling end-to-end test'

       

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=13030&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=ff888d9b-cd34-53cc-d90f-3e446d355529

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. FLINK-21103 E2e tests time out on azure

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Activity

            People

              Unassigned Unassigned
              maguowei Guowei Ma
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: