Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15607

throw exception when users trying to use Hive aggregate functions in streaming mode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • None
    • None

    Description

      Due to that Hive functions are all built for batch processing, aggregate functions in Hive that implement UDAF and GenericUDAFResolver2 interfaces may have unpredictable behaviors when used in streaming mode in Flink. We advice users to only use Hive aggregate functions interfaces in batch mode.

       

      It will be better to throw exception when users trying to use Hive aggregate functions in streaming mode. Seems need to distinguish execution mode in FunctionCatalogOperatorTable, which is not achievable yet.

      Attachments

        Activity

          People

            Unassigned Unassigned
            phoenixjiangnan Bowen Li
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: