Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15607

throw exception when users trying to use Hive aggregate functions in streaming mode

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      Due to that Hive functions are all built for batch processing, aggregate functions in Hive that implement UDAF and GenericUDAFResolver2 interfaces may have unpredictable behaviors when used in streaming mode in Flink. We advice users to only use Hive aggregate functions interfaces in batch mode.

       

      It will be better to throw exception when users trying to use Hive aggregate functions in streaming mode. Seems need to distinguish execution mode in FunctionCatalogOperatorTable, which is not achievable yet.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              phoenixjiangnan Bowen Li
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: