XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: P2
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: testing
    • Labels:
      None

      Description

      Use a persistent cache directory for pip install calls (at https://github.com/apache/beam/blob/master/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy#L1771 and some more in that file.)

      Pip does support caching (https://pip.pypa.io/en/stable/reference/pip_install/#caching) but the default directory may not be persistent across jobs.

      Kyle Weaver you mentioned that this might help with container build times. Containers are build by runnin pip inside the container, I am not sure if that will be possible to use the same shared cache for that process or not.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                altay Ahmet Altay
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: