Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3611 Support Docker Containers In LinuxContainerExecutor
  3. YARN-5428

Allow for specifying the docker client configuration directory

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • yarn
    • Reviewed

    Description

      The docker client allows for specifying a configuration directory that contains the docker client's configuration. It is common to store "docker login" credentials in this config, to avoid the need to docker login on each cluster member.

      By default the docker client config is $HOME/.docker/config.json on Linux. However, this does not work with the current container executor user switching and it may also be desirable to centralize this configuration beyond the single user's home directory.

      Note that the command line arg is for the configuration directory NOT the configuration file.

      This change will be needed to allow YARN to automatically pull images at localization time or within container executor.

      Attachments

        1. YARN-5428.001.patch
          7 kB
          Shane Kumpf
        2. YARN-5428.002.patch
          8 kB
          Shane Kumpf
        3. YARN-5428.003.patch
          8 kB
          Shane Kumpf
        4. YARN-5428.004.patch
          8 kB
          Shane Kumpf
        5. YARN-5428.005.patch
          38 kB
          Shane Kumpf
        6. YARN-5428.006.patch
          39 kB
          Shane Kumpf
        7. YARN-5428.007.patch
          44 kB
          Shane Kumpf
        8. YARN-5428.008.patch
          45 kB
          Shane Kumpf
        9. YARN-5428.009.patch
          41 kB
          Shane Kumpf
        10. YARN-5428Allowforspecifyingthedockerclientconfigurationdirectory.pdf
          46 kB
          Shane Kumpf

        Issue Links

          Activity

            People

              shanekumpf@gmail.com Shane Kumpf
              shanekumpf@gmail.com Shane Kumpf
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: