Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35375

Use Jinja2 < 3.0.0 for Python linter dependency in GA

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.1.2, 3.2.0
    • Component/s: Project Infra
    • Labels:
      None

      Description

      From a few hours ago, Python linter fails in GA.
      The latest Jinja 3.0.0 seems to cause this failure.
      https://pypi.org/project/Jinja2/

      Run ./dev/lint-python
      starting python compilation test...
      python compilation succeeded.
      
      starting pycodestyle test...
      pycodestyle checks passed.
      
      starting flake8 test...
      flake8 checks passed.
      
      starting mypy test...
      mypy checks passed.
      
      starting sphinx-build tests...
      sphinx-build checks failed:
      Running Sphinx v3.0.4
      making output directory... done
      [autosummary] generating autosummary for: development/contributing.rst, development/debugging.rst, development/index.rst, development/setting_ide.rst, development/testing.rst, getting_started/index.rst, getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, migration_guide/index.rst, ..., reference/pyspark.ml.rst, reference/pyspark.mllib.rst, reference/pyspark.resource.rst, reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, user_guide/index.rst, user_guide/python_packaging.rst
      
      Exception occurred:
        File "/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst", line 26, in top-level template code
          {% if '__init__' in methods %}
      jinja2.exceptions.UndefinedError: 'methods' is undefined
      The full traceback has been saved in /tmp/sphinx-err-ypgyi75y.log, if you want to report the issue to the developers.
      Please also report this if it was a user error, so that a better error message can be provided next time.
      A bug report can be filed in the tracker at <https://github.com/sphinx-doc/sphinx/issues>. Thanks!
      make: *** [Makefile:20: html] Error 2
      
      re-running make html to print full warning list:
      Running Sphinx v3.0.4
      making output directory... done
      [autosummary] generating autosummary for: development/contributing.rst, development/debugging.rst, development/index.rst, development/setting_ide.rst, development/testing.rst, getting_started/index.rst, getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, migration_guide/index.rst, ..., reference/pyspark.ml.rst, reference/pyspark.mllib.rst, reference/pyspark.resource.rst, reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, user_guide/index.rst, user_guide/python_packaging.rst
      
      Exception occurred:
        File "/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst", line 26, in top-level template code
          {% if '__init__' in methods %}
      jinja2.exceptions.UndefinedError: 'methods' is undefined
      The full traceback has been saved in /tmp/sphinx-err-fvtmvvwv.log, if you want to report the issue to the developers.
      Please also report this if it was a user error, so that a better error message can be provided next time.
      A bug report can be filed in the tracker at <https://github.com/sphinx-doc/sphinx/issues>. Thanks!
      make: *** [Makefile:20: html] Error 2
      Error: Process completed with exit code 2.
      

        Attachments

          Activity

            People

            • Assignee:
              sarutak Kousuke Saruta
              Reporter:
              sarutak Kousuke Saruta
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: