Details

    • Type: Sub-task
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Shuffle, Spark Core
    • Labels:
      None

      Description

      The size of ByteBuffers can not be greater than 2G, should be replaced by ChunkedByteBuffer

        Issue Links

          Activity

          Hide
          apachespark Apache Spark added a comment -

          User 'witgo' has created a pull request for this issue:
          https://github.com/apache/spark/pull/14662

          Show
          apachespark Apache Spark added a comment - User 'witgo' has created a pull request for this issue: https://github.com/apache/spark/pull/14662
          Hide
          srowen Sean Owen added a comment -

          I think we need to back up and discuss the design before submitting PRs. I'd prefer to close the PR and even this JIRA. It's not clear how it related to the previous ones, or even https://issues.apache.org/jira/browse/SPARK-17184

          Show
          srowen Sean Owen added a comment - I think we need to back up and discuss the design before submitting PRs. I'd prefer to close the PR and even this JIRA. It's not clear how it related to the previous ones, or even https://issues.apache.org/jira/browse/SPARK-17184
          Hide
          gq Guoqiang Li added a comment -

          OK

          Show
          gq Guoqiang Li added a comment - OK

            People

            • Assignee:
              Unassigned
              Reporter:
              gq Guoqiang Li
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:

                Development