Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-24936

review Jenkins build artifacts

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      Post move to the ci-hadoop build servers we are now the biggest user of space. That is not a problem in and of itself, but the master node has run out of disk space twice now. As of this snapshot we are using 125GB of storage and the next largest project is only using 20GB.

      https://paste.apache.org/kyrds

      We should review our builds for any issues and come up with expectations for what our steady-state disk usage should look like

      • we are supposed to compress any test logs (usually this gets us 90-99% space savings)
      • we are supposed to clean up workspaces when jobs are done
      • we are supposed to keep a fixed window of prior builds (either by days or number of runs)

      If all of our jobs are currently following these guidelines, another possibility is to push the artifacts we need over to nightlies.a.o. Barring that, we should formally request asf infra set up a plugin for storing artifact on s3.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zhangduo Duo Zhang Assign to me
            busbey Sean Busbey
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment