Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34430

Update index.md with a pyspark hint to avoid java.nio.DirectByteBuffer.(long, int) not available

    XMLWordPrintableJSON

    Details

      Description

      Took us a while to figure out how to fix this with pyspark this might save a few people a few hours...

       

      The documentation describes vaguely how to fix the issue, by setting a parameter but without an actual working example. 

      With the given PySpark example it should hold enough information to set this in other scenarios as well.

       

       

      Kept the change to the docs as small as possible. 

      What changes were proposed in this pull request?

      doc update, see title

      Why are the changes needed?

      save people time figuring out how to resolve it

      Does this PR introduce any user-facing change?

      no

      How was this patch tested?

      no code changes

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Nozziel Marco van der Linden
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 1h
                1h
                Remaining:
                Remaining Estimate - 1h
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified