Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1837

NumericRange should be partitioned in the same way as other sequences

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.1.0
    • Spark Core
    • None

    Description

      Otherwise, RDD.zip() would behave unexpectedly. For example, as given in SPARK-1817:

      scala> sc.parallelize(1L to 2L,4).zip(sc.parallelize(11 to 12,4)).collect
      res1: Array[(Long, Int)] = Array((2,11))

      Attachments

        Issue Links

          Activity

            People

              kzhang Kan Zhang
              kzhang Kan Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: