Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6237

ULR ValidatesRunner tests not deleting artifacts.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.11.0
    • Component/s: runner-direct
    • Labels:
      None

      Description

      When running ValidatesRunner tests with the ULR, artifacts are never deleted. Since a new job is run per test, this uses up massive amounts of disk storage quickly (over 20 Gigabytes per execution). This often causes the machine running these tests to run out of disk space which means tests start failing.

      The ULR should be modified to delete these artifacts after they have been staged to avoid this issue. Flink already does this, so the infrastructure exists.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                danoliveira Daniel Oliveira
                Reporter:
                danoliveira Daniel Oliveira
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m