[HIVE-13586] Allow UDFs/UDTFs to indicate whether they can run with fetch task conversion

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Component/s: UDF
• Assignee: Jason Dere
• Reporter: Jason Dere
• Created: 22/Apr/16 00:11
• Updated: 05/Jan/17 19:14
• Resolved: 05/Jan/17 19:14

Description

Some UDFs/UDTFs cannot run properly with fetch task conversion.
For UDFs:

• The UDF may be depending on files/archives added to the distributed cache, which may not be available in the local fetch task.
• The UDF may be depending on GenericUDF.configure() to be called - this is not called for locally run UDFs.

For UDTFs, one issue is HIVE-11892.

A bit of a workaround, but for such UDFs/UDTFs we can have a flag to indicate whether the UDF should be allowed to run in a local fetch task.

Issue Links

• is related to: HIVE-11892 UDTF run in local fetch task does not return rows forwarded during GenericUDTF.close()
• relates to: HIVE-13609 Fix UDTFs to allow local fetch task to fetch rows forwarded by GenericUDTF.close()
• links to: https://reviews.apache.org/r/46575/