Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-39515 Improve/recover scheduled jobs in GitHub Actions
  3. SPARK-39521

Define each workflow for each scheduled job in GitHub Actions

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • Project Infra
    • None

    Description

      it is very difficult to navigate scheduled jobs now. We should use https://github.com/apache/spark/actions/workflows/build_and_test.yml?query=event%3Aschedule link and manually search one by one.

      Since GitHub added the feature to import other workflow, we should leverage this feature, see also https://github.com/apache/spark/blob/master/.github/workflows/build_and_test_ansi.yml. Once we can separate them, it will be defined as a separate workflows. We might have to clean up existing build history to make it easier to read (it requires committer-only permission to clean them up).

      Namely, each scheduled job should be classified under "All workflows" at https://github.com/apache/spark/actions so other developers can easily track them.

      See also https://docs.github.com/en/actions/using-workflows/reusing-workflows

      Attachments

        Activity

          People

            gurwls223 Hyukjin Kwon
            hyukjin.kwon Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: