Details

    • Type: Sub-task
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Spark Core
    • Labels:
      None

      Description

      The size of ByteBuf can not be greater than 2G, should be replaced by InputStream.

        Issue Links

          Activity

          Hide
          srowen Sean Owen added a comment -

          Before opening JIRAs, could you please respond to the request for a brief design doc? this is a significant change, so we'd want to get some consensus on the approach before you go do work, and also record in JIRA tasks that seem to indicate a particular direction. I'm not sure that's agreed yet

          Show
          srowen Sean Owen added a comment - Before opening JIRAs, could you please respond to the request for a brief design doc? this is a significant change, so we'd want to get some consensus on the approach before you go do work, and also record in JIRA tasks that seem to indicate a particular direction. I'm not sure that's agreed yet
          Hide
          apachespark Apache Spark added a comment -

          User 'witgo' has created a pull request for this issue:
          https://github.com/apache/spark/pull/14751

          Show
          apachespark Apache Spark added a comment - User 'witgo' has created a pull request for this issue: https://github.com/apache/spark/pull/14751
          Hide
          gq Guoqiang Li added a comment -

          OK, I'll post the detailed design document later.

          Show
          gq Guoqiang Li added a comment - OK, I'll post the detailed design document later.
          Hide
          srowen Sean Owen added a comment -

          I'd prefer that you close https://github.com/apache/spark/pull/14647 https://github.com/apache/spark/pull/14751 and back up and do this first, yes.

          Show
          srowen Sean Owen added a comment - I'd prefer that you close https://github.com/apache/spark/pull/14647 https://github.com/apache/spark/pull/14751 and back up and do this first, yes.
          Hide
          gq Guoqiang Li added a comment -

          ok

          Show
          gq Guoqiang Li added a comment - ok

            People

            • Assignee:
              Unassigned
              Reporter:
              gq Guoqiang Li
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development