Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21262

Stop sending 'stream request' when shuffle blocks.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.1.1
    • None
    • Shuffle, Spark Core

    Description

      In current code(master branch), client will fetch the remote huge blocks to disk. It is implemented by sending 'stream request', which needs server side support(change). Thus this change will break old shuffle service.

      Attachments

        Activity

          People

            Unassigned Unassigned
            jinxing6042@126.com Jin Xing
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: