Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18888

partitionBy in DataStreamWriter in Python throws _to_seq not defined

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 2.0.2
    • 2.1.0
    • None

    Description

      python/pyspark/sql/streaming.py in partitionBy(self, *cols)
          716         if len(cols) == 1 and isinstance(cols[0], (list, tuple)):
          717             cols = cols[0]
      --> 718         self._jwrite = self._jwrite.partitionBy(_to_seq(self._spark._sc, cols))
          719         return self
          720 
      
      NameError: global name '_to_seq' is not defined
      

      Attachments

        Activity

          People

            brkyvz Burak Yavuz
            brkyvz Burak Yavuz
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: