Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1251

Python 3 Support

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.11.0
    • sdk-py-core
    • None

    Description

      FAQ

      Does Apache Beam support Python 3?

      • Yes!

      Is there any remaining work?

      Which SDK version should I use?

      • For best experience, use the latest released SDK. For summary of Py3-related changes, read this thread.

      Help! I am getting a pickling error in StockUnpickler.find_class() on Python 3.

      • Does the error happens in load_session call? See BEAM-6158 .
      • Do you use Beam SDK less than 2.17.0? See BEAM-8651.

      My Avro Sink no longer works.

      • Beam switched to use FastAvro as a default library on Python 3. The fastavro-based Avro sink expects schema as a dictionary, while the avro-python3-based Avro Sink expects a schema that was previously parsed by avro.schema.Parse(). Fastavro will not accept a schema parsed by avro-python3, so make sure you pass the correct schema. See: BEAM-10769.

      My streaming pipelines are stuck on Python 3.

      • Do you use Beam SDK less than 2.17.0? If so please upgrade to 2.17.0. See BEAM-8651.

      Attachments

        Issue Links

          Activity

            People

              tvalentyn Valentyn Tymofieiev
              eyad.alsibai@gmail.com Eyad Sibai
              Votes:
              39 Vote for this issue
              Watchers:
              64 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 516h 40m
                  516h 40m