Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-524

Description of "type" argument in Aggregator is incorrect

Details

    • Bug
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • None
    • Not applicable
    • sdk-py-core
    • None

    Description

      Two problems with documentation for "type" argument.

      Trivial: Remove "by default". This phrase implies that there are other alternatives besides what is listed. There aren't.

      Non trivial. The documentation says "types appropriate to the combine_fn" are accepted. I tried
      Accumulator("foo", max, datetime.datetime)
      This failed even though "datetime.datetime" is a perfectly reasonable type to want to take the max of. (I wanted to know precisely when the last job finished.)

      Either the documentation needs to be changed to specify that max/min only apply to numeric types, or the code needs to be changed to allow other uses of min and max.

      I suspect that the other operators also suffer similar limitations. I doubt that I'd be allowed to sum numpy arrays, even though they support +.

      Attachments

        Activity

          People

            Unassigned Unassigned
            fyellin Frank Yellin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: