Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12136

Add deterministic coders for common Python types

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • sdk-py-core

    Description

      FastPrimitivesCodeImpl has "fallback" deterministic encoding of certain types in encode_special_deterministic. This encoding is not as efficient as a type-specific coder (https://github.com/apache/beam/pull/14455).

      This bug is to implement type-specific coders for the types supported in encode_special_deterministic. This method will still handle encoding for cases in which type information is not available, and the new coders will be used where type hints are available.

      Types to implement coders for: enum.Enum, dataclasses.dataclass, collections.namedtuple / typing.NamedTuple (verify there's no conflict/duplication with RowCoder)

      Attachments

        Activity

          People

            Unassigned Unassigned
            udim Udi Meiri
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 40m
                3h 40m