Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-2350

Shrink size of spark_integration Docker container

    XMLWordPrintableJSON

    Details

      Description

      I would like to propose a few changes to the spark_integration Dockerfile:

      https://github.com/apache/arrow/tree/master/dev/spark_integration

      The size of the resulting image can be reduced by making the following changes:

      • consolidating all RUN commands into a single RUN layer (reducing the number of layers)
      • running apt-get clean to clear out the package cache
      • running conda clean --all to clear out cached package tarballs, abandoned package versions, and other build artifacts from all the libraries that are conda installed

      I will be submitting a PR on GitHub shortly. Generating this issue first so I can tag my PR to it.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jameslamb James Lamb
                Reporter:
                jameslamb James Lamb
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 10m
                  10m
                  Remaining:
                  Remaining Estimate - 10m
                  10m
                  Logged:
                  Time Spent - Not Specified
                  Not Specified