Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11671

Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.5.1
    • 1.6.0
    • Documentation, PySpark
    • None

    Description

      PySpark documentation error:

      sqlContext.createDataFrame(pandas.DataFrame([[1, 2]]).collect()) 
      

      Results in:

      ---------------------------------------------------------------------------
      AttributeError                            Traceback (most recent call last)
      <ipython-input-14-120201b3ef75> in <module>()
      ----> 1 sqlContext.createDataFrame(pandas.DataFrame([[1, 2]]).collect())
      
      /usr/local/src/bluemix_ipythonspark_141/notebook/lib/python2.7/site-packages/pandas-0.14.0-py2.7-linux-x86_64.egg/pandas/core/generic.pyc in __getattr__(self, name)
         1841                 return self[name]
         1842             raise AttributeError("'%s' object has no attribute '%s'" %
      -> 1843                                  (type(self).__name__, name))
         1844 
         1845     def __setattr__(self, name, value):
      
      AttributeError: 'DataFrame' object has no attribute 'collect'
      

      Attachments

        Activity

          People

            snowch chris snow
            snowch chris snow
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: