Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-12826

[R] [CI] Add caching to revdepchecks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • None
    • Continuous Integration, R
    • None

    Description

      With ARROW-12569 we added a (manual) reverse dependency check job. This runs fine (if slow) for a one-off run. It should be possible to cache between runs. There are a few issues with this currently:

      • {revdepcheck}

        does not (yet) support only running new runs

      • The cache doesn't cache some of the longest running tasks (installing the reverse dependencies)
      • If we cache the revdeps directory, we will need to re-add packages that should be re-checked.

      We should investigate contributing to revdepcheck to resolve the run-only-new and possibly also add features for cacheing the installations (and only change when the crancache is invalidated / finds a new package?) https://github.com/HenrikBengtsson/revdepcheck.extras might also be helpful

      For posterity, the following is ~what we would need to add to dev/tasks/r/github.linux.revdepcheck.yml
      ```

      • name: Cache crancache and revdeps directory
        uses: actions/cache@v2
        with:
        key: {{ "r-revdep-cache-${{ some-way-to-get-arrow-version }}" }}
        path: |
        arrow/r/revdep
        arrow/.crancache
        ```

      Attachments

        Activity

          People

            Unassigned Unassigned
            jonkeane Jonathan Keane
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: