Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-17313

Support spark-shell on cluster mode

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • None
    • None

    Description

      The main issue with the current spark shell is that the driver is running on the user machine. If the driver resource requirement is beyond user machine capacity, then spark shell will be useless. If we are to add the cluster mode(Yarn or Mesos ) for spark shell via some sort of proxy where user machine only hosts a rest client to the running driver at the cluster, the shell will be more powerful

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. SPARK-17312 Support spark-shell on cluster mode

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. SPARK-17312 Support spark-shell on cluster mode

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              mfelgamal Mahmoud Elgamal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: