Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22402

Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Incomplete
    • Affects Version/s: 2.2.0, 2.3.0
    • Fix Version/s: None
    • Component/s: Mesos
    • Labels:

      Description

      Currently spark.mesos.uris will only place files in the sandbox, but some configuration files and applications may need to be in specific locations. The Mesos proto allows for this with the optional output_file field (https://github.com/apache/mesos/blob/master/include/mesos/mesos.proto#L671). We can expose this through the command line with --conf spark.mesos.uris=<uri>:<path>

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              arand Arthur Rand
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: