Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2266

[CI] Improve runtime of integration tests in Travis CI

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      I was surprised to see that travis_script_integration.sh is taking over 25 minutes to run (https://travis-ci.org/apache/arrow/jobs/349493491). My only real guess about what's going on is that JVM startup time on these hosts is super slow.

      I can think of some things we could do to make things better:

      • Add debugging output so we can see what's slow
      • Write a Java integration test handler that validates multiple files at once
      • Generate a single set of binary files for each producer rather than regenerating them each time (so Java would only need to produce binary files once instead of 3 times like now)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              wesm Wes McKinney
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: