XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • PySpark
    • None

    Description

      To simplify initial port we merge all existing stubs.

      However, some of these cover non-API components and are usually dynamically annotated (generated with stubgen).

      This includes modules like serializers, utils, shell, worker, etc.

      These can be safely removed as:

      • MyPy can infer types from the source, where stub is not present.
      • No longer provide value, when corresponding modules are present in the same directory structure.
      • Annotations are here primarily to help end users, not Spark developers and many of the annotations cannot be meaningfully refined.

      It should also reduce overhead of maintaining annotations (especially when places where we don't guarantee signature stability).

      Attachments

        Activity

          People

            zero323 Maciej Szymkiewicz
            zero323 Maciej Szymkiewicz
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: