Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-5332

Fix slow running Integration Tests

    XMLWordPrintableJSON

    Details

    • Type: Test
    • Status: Resolved
    • Priority: Major
    • Resolution: Implemented
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      I picked out the slow running tests. From the last (only) successful jenkins run.
      The overall run took 3 hr 9 min (on H26)

      I picked the slow ones in the following way:

      • More than 60s in the default tests
      • More than 120s in the StatsEnabledTests
      • And more than 200s in StatsDisabledTests, etc.
      [INFO] --- maven-surefire-plugin:2.20:test (default-test) @ phoenix-core ---
      
      [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.455 s - in org.apache.phoenix.iterate.ChunkedResultIteratorTest
      [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 66.869 s - in org.apache.phoenix.util.CoprocessorHConnectionTableFactoryTest
      
      
      [INFO] --- maven-failsafe-plugin:2.20:integration-test (ParallelStatsEnabledTest) @ phoenix-core ---
      
      [INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 108.031 s - in org.apache.phoenix.end2end.QueryWithTableSampleIT
      [INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.746 s - in org.apache.phoenix.end2end.ExplainPlanWithStatsEnabledIT
      [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 222.043 s - in org.apache.phoenix.end2end.TenantSpecificTablesDDLIT
      [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 212.731 s - in org.apache.phoenix.end2end.TenantSpecificTablesDMLIT
      
      
      [INFO] --- maven-failsafe-plugin:2.20:integration-test (ParallelStatsDisabledTest) @ phoenix-core ---
      
      [INFO] Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 501.869 s - in org.apache.phoenix.end2end.AlterTableIT
      [INFO] Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 453.287 s - in org.apache.phoenix.end2end.CastAndCoerceIT
      [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 576.443 s - in org.apache.phoenix.end2end.CaseStatementIT
      [INFO] Tests run: 57, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 395.982 s - in org.apache.phoenix.end2end.DateTimeIT
      [INFO] Tests run: 64, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 560.619 s - in org.apache.phoenix.end2end.DeleteIT
      [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 596.039 s - in org.apache.phoenix.end2end.InQueryIT
      [INFO] Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 330.19 s - in org.apache.phoenix.end2end.NotQueryWithGlobalImmutableIndexesIT
      [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 672.726 s - in org.apache.phoenix.end2end.GroupByIT
      [INFO] Tests run: 70, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 664.045 s - in org.apache.phoenix.end2end.IntArithmeticIT
      [INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 383.414 s - in org.apache.phoenix.end2end.NotQueryWithLocalImmutableIndexesIT
      [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 230.93 s - in org.apache.phoenix.end2end.OrderByWithServerClientSpoolingDisabledIT
      [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 227.712 s - in org.apache.phoenix.end2end.OrderByIT
      [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 228.137 s - in org.apache.phoenix.end2end.OrderByWithSpillingIT
      [INFO] Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 537.589 s - in org.apache.phoenix.end2end.NullIT
      [INFO] Tests run: 48, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 446.558 s - in org.apache.phoenix.end2end.OnDuplicateKeyIT
      [INFO] Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,262.998 s - in org.apache.phoenix.end2end.InListIT
      [INFO] Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 582.677 s - in org.apache.phoenix.end2end.OrphanViewToolIT
      [INFO] Tests run: 55, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 254.14 s - in org.apache.phoenix.end2end.ProductMetricsIT
      [INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 300.546 s - in org.apache.phoenix.end2end.PropertiesInSyncIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 410.912 s - in org.apache.phoenix.end2end.PointInTimeQueryIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 400.997 s - in org.apache.phoenix.end2end.QueryIT
      [INFO] Tests run: 47, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 240.318 s - in org.apache.phoenix.end2end.RowValueConstructorIT
      [INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 285.189 s - in org.apache.phoenix.end2end.SetPropertyOnNonEncodedTableIT
      [INFO] Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 524.262 s - in org.apache.phoenix.end2end.RangeScanIT
      [INFO] Tests run: 46, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 283.875 s - in org.apache.phoenix.end2end.SortOrderIT
      [INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 294.88 s - in org.apache.phoenix.end2end.StoreNullsIT
      [INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 240.646 s - in org.apache.phoenix.end2end.VariableLengthPKIT
      [INFO] Tests run: 35, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 336.108 s - in org.apache.phoenix.end2end.UngroupedIT
      [INFO] Tests run: 52, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 434.348 s - in org.apache.phoenix.end2end.UpsertSelectIT
      [INFO] Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 265.486 s - in org.apache.phoenix.end2end.index.DropColumnIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 468.432 s - in org.apache.phoenix.end2end.index.GlobalImmutableNonTxIndexIT
      [INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 238.975 s - in org.apache.phoenix.end2end.index.IndexMetadataIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 468.03 s - in org.apache.phoenix.end2end.index.GlobalMutableNonTxIndexIT
      [INFO] Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 249.307 s - in org.apache.phoenix.end2end.index.IndexWithTableSchemaChangeIT
      [INFO] Tests run: 39, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 398.894 s - in org.apache.phoenix.end2end.index.IndexUsageIT
      [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 710.764 s - in org.apache.phoenix.end2end.index.GlobalImmutableTxIndexIT
      [INFO] Tests run: 63, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 683.769 s - in org.apache.phoenix.end2end.index.GlobalMutableTxIndexIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 522.919 s - in org.apache.phoenix.end2end.index.LocalImmutableNonTxIndexIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 514.189 s - in org.apache.phoenix.end2end.index.LocalImmutableTxIndexIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 519.565 s - in org.apache.phoenix.end2end.index.LocalMutableNonTxIndexIT
      [INFO] Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 515.596 s - in org.apache.phoenix.end2end.index.LocalMutableTxIndexIT
      [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 665.824 s - in org.apache.phoenix.end2end.index.MutableIndexSplitForwardScanIT
      [INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 310.472 s - in org.apache.phoenix.end2end.join.HashJoinNoIndexIT
      [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 672.243 s - in org.apache.phoenix.end2end.index.MutableIndexSplitReverseScanIT
      [INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 573.679 s - in org.apache.phoenix.end2end.join.HashJoinGlobalIndexIT
      [INFO] Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 413.78 s - in org.apache.phoenix.end2end.join.SubqueryIT
      [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 376.881 s - in org.apache.phoenix.end2end.join.SortMergeJoinNoIndexIT
      [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 648.02 s - in org.apache.phoenix.end2end.join.SortMergeJoinGlobalIndexIT
      [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 849.373 s - in org.apache.phoenix.end2end.join.HashJoinLocalIndexIT
      [INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 284.452 s - in org.apache.phoenix.end2end.join.SubqueryUsingSortMergeJoinIT
      [INFO] Tests run: 117, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,387.919 s - in org.apache.phoenix.end2end.index.MutableIndexIT
      [INFO] Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 867.228 s - in org.apache.phoenix.end2end.join.SortMergeJoinLocalIndexIT
      [INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 428.32 s - in org.apache.phoenix.tx.TxCheckpointIT
      [INFO] Tests run: 78, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 726.224 s - in org.apache.phoenix.tx.ParameterizedTransactionIT
      
      
      [INFO] --- maven-failsafe-plugin:2.20:integration-test (HBaseManagedTimeTests) @ phoenix-core ---
      
      [INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 197.833 s - in org.apache.phoenix.end2end.IndexExtendedIT
      [INFO] Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 202.324 s - in org.apache.phoenix.end2end.FlappingLocalIndexIT
      [INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 219.961 s - in org.apache.phoenix.end2end.IndexBuildTimestampIT
      [INFO] Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 440.555 s - in org.apache.phoenix.end2end.CostBasedDecisionIT
      [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 271.925 s - in org.apache.phoenix.end2end.PermissionNSEnabledIT
      [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 428.637 s - in org.apache.phoenix.end2end.LocalIndexSplitMergeIT
      [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 429.078 s - in org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT
      [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 284.159 s - in org.apache.phoenix.end2end.PermissionsCacheIT
      [INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 292.645 s - in org.apache.phoenix.end2end.index.MutableIndexFailureIT
      [WARNING] Tests run: 45, Failures: 0, Errors: 0, Skipped: 18, Time elapsed: 461.384 s - in org.apache.phoenix.end2end.index.ImmutableIndexIT
      [INFO] Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 677.407 s - in org.apache.phoenix.end2end.index.LocalIndexIT
      [INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,059.417 s - in org.apache.phoenix.end2end.SystemCatalogCreationOnConnectionIT
      [INFO] Tests run: 35, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 342.872 s - in org.apache.phoenix.end2end.join.SortMergeJoinNoSpoolingIT
      [INFO] Tests run: 31, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 463.565 s - in org.apache.phoenix.end2end.index.PartialIndexRebuilderIT
      [WARNING] Tests run: 26, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 250.928 s - in org.apache.phoenix.schema.stats.NamespaceDisabledStatsCollectorIT
      [WARNING] Tests run: 26, Failures: 0, Errors: 0, Skipped: 4, Time elapsed: 275.674 s - in org.apache.phoenix.schema.stats.NamespaceEnabledStatsCollectorIT
      [WARNING] Tests run: 39, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 221.189 s - in org.apache.phoenix.schema.stats.NonTxStatsCollectorIT
      [WARNING] Tests run: 78, Failures: 0, Errors: 0, Skipped: 12, Time elapsed: 388.278 s - in org.apache.phoenix.schema.stats.TxStatsCollectorIT
      [INFO] Tests run: 164, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2,237.378 s - in org.apache.phoenix.end2end.IndexToolIT
      
      
      [INFO] --- maven-failsafe-plugin:2.20:integration-test (SplitSystemCatalogTests) @ phoenix-core ---
      
      [WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 232.007 s - in org.apache.phoenix.end2end.index.ViewIndexIT
      [INFO] Tests run: 112, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,158.968 s - in org.apache.phoenix.end2end.AlterTableWithViewsIT
      [INFO] Tests run: 165, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,226.699 s - in org.apache.phoenix.end2end.ViewIT
      

        Attachments

        1. 1.5-test-times.txt
          28 kB
          Lars Hofhansl
        2. master-test-times.txt
          28 kB
          Lars Hofhansl

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              larsh Lars Hofhansl
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: