Details

    • Type: Sub-task
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Shuffle, Spark Core
    • Labels:
      None

      Description

      Due to the use java.nio.ByteBuffer, BlockManager does not support blocks larger than 2G.

        Issue Links

          Activity

          Hide
          apachespark Apache Spark added a comment -

          User 'squito' has created a pull request for this issue:
          https://github.com/apache/spark/pull/8320

          Show
          apachespark Apache Spark added a comment - User 'squito' has created a pull request for this issue: https://github.com/apache/spark/pull/8320
          Hide
          apachespark Apache Spark added a comment -

          User 'witgo' has created a pull request for this issue:
          https://github.com/apache/spark/pull/14664

          Show
          apachespark Apache Spark added a comment - User 'witgo' has created a pull request for this issue: https://github.com/apache/spark/pull/14664

            People

            • Assignee:
              Unassigned
              Reporter:
              rxin Reynold Xin
            • Votes:
              6 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:

                Development