Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34430

Update index.md with a pyspark hint to avoid java.nio.DirectByteBuffer.(long, int) not available

    XMLWordPrintableJSON

Details

    • Documentation
    • Status: Resolved
    • Trivial
    • Resolution: Won't Fix
    • 3.0.0
    • None
    • Documentation

    Description

      Took us a while to figure out how to fix this with pyspark this might save a few people a few hours...

       

      The documentation describes vaguely how to fix the issue, by setting a parameter but without an actual working example. 

      With the given PySpark example it should hold enough information to set this in other scenarios as well.

       

       

      Kept the change to the docs as small as possible. 

      What changes were proposed in this pull request?

      doc update, see title

      Why are the changes needed?

      save people time figuring out how to resolve it

      Does this PR introduce any user-facing change?

      no

      How was this patch tested?

      no code changes

      Attachments

        Activity

          People

            Unassigned Unassigned
            Nozziel Marco van der Linden
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 1h
                1h
                Remaining:
                Remaining Estimate - 1h
                1h
                Logged:
                Time Spent - Not Specified
                Not Specified