Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12506

Change WindowedValueHolder into a Row Schema

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • Missing
    • runner-py-interactive
    • None

    Description

      The WindowedValueHolder is a Python type that requires a special `SafeFastPrimitivesCoder` instead of the native `FastPrimitivesCoder` in cache_manager to encode and decode.

      When reading cache of it and applying an external transform such as a SqlTransform, it introduces a pickled Python coder that is not xLang friendly.

      We could build a Row schema to hold the WindowedValueHolder to make the cache reading xLang friendly and also get rid of the additional layer of `SafeFastPrimitivesCoder`.

      Attachments

        Activity

          People

            ningk Ning
            ningk Ning
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3.5h
                3.5h