Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13058 [Dev] Improve nightly build visibility
  3. ARROW-13059

[Dev] Adapt the crossbow code to save build status to json

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Developer Tools
    • Labels:
      None

      Description

      Add to / adapt the code that archery crossbow already uses to send the email report to also save the status of the builds to a json file and commit that to a new branch in the crossbow (or some other ursacomputing repository)

      Crossbow code (hint this is the code that you will want to copy + adapt to do this new task): https://github.com/apache/arrow/blob/master/dev/archery/archery/crossbow/reports.py

      This is how the nightly jobs are triggered: https://github.com/ursacomputing/crossbow/blob/master/.github/workflows/nightly_report.yml
      (note that it figures out what the job id is and then it runs a command archery crossbow report ...

      The archer CLI interface is specifiedin https://github.com/apache/arrow/blob/master/dev/archery/archery/crossbow/cli.py

      Ultimately what we want is something like: a new command like crossbow archery save-report-data that uses similar code/approaches to how the report is designed but saves the data to json (or line delimited json) and saves that somewhere reliable (i.e. the ursacomputing/crossbow repository or a new repository under ursacomputing)

        Attachments

          Activity

            People

            • Assignee:
              pachamaltese Mauricio 'PachĂĄ' Vargas SepĂșlveda
              Reporter:
              jonkeane Jonathan Keane
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: